Nov 14 11:02:17 user nova-compute[75255]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75255) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 11:02:17 user nova-compute[75255]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75255) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 11:02:17 user nova-compute[75255]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75255) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 11:02:17 user nova-compute[75255]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 11:02:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:02:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:02:18 user nova-compute[75255]: INFO nova.virt.driver [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 11:02:18 user nova-compute[75255]: INFO nova.compute.provider_config [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Acquiring lock "singleton_lock" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Acquired lock "singleton_lock" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Releasing lock "singleton_lock" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Full set of CONF: {{(pid=75255) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ******************************************************************************** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Configuration options gathered from: {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ================================================================================ {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] allow_resize_to_same_host      = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] arq_binding_timeout            = 300 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] backdoor_port                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] backdoor_socket                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] block_device_allocate_retries  = 300 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] block_device_allocate_retries_interval = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cert                           = self.pem {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute_monitors               = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] config_dir                     = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] config_drive_format            = iso9660 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] config_source                  = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] console_host                   = user {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] control_exchange               = nova {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cpu_allocation_ratio           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] daemon                         = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] debug                          = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] default_access_ip_network_name = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] default_availability_zone      = nova {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] default_ephemeral_format       = ext4 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] default_green_pool_size        = 1000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] default_schedule_zone          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] disk_allocation_ratio          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] enable_new_services            = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] enabled_ssl_apis               = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] flat_injected                  = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] force_config_drive             = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] force_raw_images               = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] graceful_shutdown_timeout      = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] heal_instance_info_cache_interval = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] host                           = user {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instance_build_timeout         = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instance_delete_interval       = 300 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instance_name_template         = instance-%08x {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instance_usage_audit           = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instance_usage_audit_period    = month {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] internal_service_availability_zone = internal {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] key                            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] live_migration_retry_count     = 30 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_config_append              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_dir                        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_file                       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_options                    = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_rotate_interval            = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_rotate_interval_type       = days {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] log_rotation_type              = none {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] long_rpc_timeout               = 1800 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] max_concurrent_builds          = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] max_concurrent_live_migrations = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] max_concurrent_snapshots       = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] max_local_block_devices        = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] max_logfile_count              = 30 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] max_logfile_size_mb            = 200 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] maximum_instance_delete_attempts = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] metadata_listen                = 0.0.0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] metadata_listen_port           = 8775 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] metadata_workers               = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] migrate_max_retries            = -1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] mkisofs_cmd                    = genisoimage {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] my_ip                          = 10.0.0.210 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] network_allocate_retries       = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] osapi_compute_listen_port      = 8774 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] osapi_compute_unique_server_name_scope =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] osapi_compute_workers          = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] password_length                = 12 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] periodic_enable                = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] periodic_fuzzy_delay           = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] pointer_model                  = ps2mouse {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] preallocate_images             = none {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] publish_errors                 = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] pybasedir                      = /opt/stack/nova {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ram_allocation_ratio           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rate_limit_burst               = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rate_limit_except_level        = CRITICAL {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rate_limit_interval            = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] reboot_timeout                 = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] reclaim_instance_interval      = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] record                         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] reimage_timeout_per_gb         = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] report_interval                = 120 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rescue_timeout                 = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] reserved_host_cpus             = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] reserved_host_disk_mb          = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] reserved_host_memory_mb        = 512 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] reserved_huge_pages            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] resize_confirm_window          = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] resize_fs_using_block_device   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] resume_guests_state_on_host_boot = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rpc_response_timeout           = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] run_external_periodic_tasks    = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] running_deleted_instance_action = reap {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] running_deleted_instance_timeout = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler_instance_sync_interval = 120 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_down_time              = 720 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] servicegroup_driver            = db {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] shelved_offload_time           = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] shelved_poll_interval          = 3600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] shutdown_timeout               = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] source_is_ipv6                 = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ssl_only                       = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] state_path                     = /opt/stack/data/nova {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] sync_power_state_interval      = 600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] sync_power_state_pool_size     = 1000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] syslog_log_facility            = LOG_USER {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] tempdir                        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] timeout_nbd                    = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] transport_url                  = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] update_resources_interval      = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] use_cow_images                 = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] use_eventlog                   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] use_journal                    = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] use_json                       = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] use_rootwrap_daemon            = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] use_stderr                     = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] use_syslog                     = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vcpu_pin_set                   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plugging_is_fatal          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plugging_timeout           = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] virt_mkfs                      = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] volume_usage_poll_interval     = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] watch_log_file                 = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] web                            = /usr/share/spice-html5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_concurrency.disable_process_locking = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.auth_strategy              = keystone {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.compute_link_prefix        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.dhcp_domain                = novalocal {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.enable_instance_password   = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.glance_link_prefix         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.instance_list_per_project_cells = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.list_records_by_skipping_down_cells = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.local_metadata_per_cell    = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.max_limit                  = 1000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.metadata_cache_expiration  = 15 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.neutron_default_tenant_id  = default {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.use_forwarded_for          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.use_neutron_default_nets   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.vendordata_dynamic_targets = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.vendordata_jsonfile_path   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.backend_argument         = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.config_prefix            = cache.oslo {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.dead_timeout             = 60.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.debug_cache_backend      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.enable_retry_client      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.enable_socket_keepalive  = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.enabled                  = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.expiration_time          = 600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.hashclient_retry_attempts = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_dead_retry      = 300 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_password        =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_sasl_enabled    = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.memcache_username        =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.proxies                  = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.retry_attempts           = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.retry_delay              = 0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.socket_keepalive_count   = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.socket_keepalive_idle    = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.socket_keepalive_interval = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.tls_allowed_ciphers      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.tls_cafile               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.tls_certfile             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.tls_enabled              = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cache.tls_keyfile              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.auth_section            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.auth_type               = password {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.cafile                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.certfile                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.collect_timing          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.cross_az_attach         = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.debug                   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.endpoint_template       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.http_retries            = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.insecure                = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.keyfile                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.os_region_name          = RegionOne {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.split_loggers           = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cinder.timeout                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.cpu_dedicated_set      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.cpu_shared_set         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.image_type_exclude_list = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.resource_provider_association_refresh = 300 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.shutdown_retry_interval = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] conductor.workers              = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] console.allowed_origins        = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] console.ssl_ciphers            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] console.ssl_minimum_version    = default {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] consoleauth.token_ttl          = 600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.cafile                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.certfile                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.collect_timing          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.connect_retries         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.connect_retry_delay     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.endpoint_override       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.insecure                = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.keyfile                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.max_version             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.min_version             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.region_name             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.service_name            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.service_type            = accelerator {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.split_loggers           = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.status_code_retries     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.status_code_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.timeout                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] cyborg.version                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.backend               = sqlalchemy {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.connection            = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.connection_debug      = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.connection_parameters =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.connection_recycle_time = 3600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.connection_trace      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.db_inc_retry_interval = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.db_max_retries        = 20 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.db_max_retry_interval = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.db_retry_interval     = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.max_overflow          = 50 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.max_pool_size         = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.max_retries           = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.mysql_wsrep_sync_wait = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.pool_timeout          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.retry_interval        = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.slave_connection      = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] database.sqlite_synchronous    = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.backend           = sqlalchemy {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.connection        = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.connection_debug  = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.connection_parameters =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.connection_recycle_time = 3600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.connection_trace  = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.db_inc_retry_interval = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.db_max_retries    = 20 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.db_max_retry_interval = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.db_retry_interval = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.max_overflow      = 50 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.max_pool_size     = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.max_retries       = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.pool_timeout      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.retry_interval    = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.slave_connection  = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] api_database.sqlite_synchronous = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] devices.enabled_mdev_types     = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ephemeral_storage_encryption.enabled = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.api_servers             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.cafile                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.certfile                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.collect_timing          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.connect_retries         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.connect_retry_delay     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.debug                   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.default_trusted_certificate_ids = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.enable_certificate_validation = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.enable_rbd_download     = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.endpoint_override       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.insecure                = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.keyfile                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.max_version             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.min_version             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.num_retries             = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.rbd_ceph_conf           =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.rbd_connect_timeout     = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.rbd_pool                =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.rbd_user                =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.region_name             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.service_name            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.service_type            = image {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.split_loggers           = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.status_code_retries     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.status_code_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.timeout                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.verify_glance_signatures = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] glance.version                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] guestfs.debug                  = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.config_drive_cdrom      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.config_drive_inject_password = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.enable_remotefx         = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.instances_path_share    =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.limit_cpu_features      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.use_multipath_io        = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.vswitch_name            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] mks.enabled                    = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] image_cache.manager_interval   = 2400 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] image_cache.precache_concurrency = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] image_cache.remove_unused_base_images = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] image_cache.subdirectory_name  = _base {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.api_max_retries         = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.api_retry_interval      = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.auth_section            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.auth_type               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.cafile                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.certfile                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.collect_timing          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.conductor_group         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.connect_retries         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.connect_retry_delay     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.endpoint_override       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.insecure                = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.keyfile                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.max_version             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.min_version             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.peer_list               = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.region_name             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.serial_console_state_timeout = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.service_name            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.service_type            = baremetal {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.split_loggers           = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.status_code_retries     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.status_code_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.timeout                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ironic.version                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] key_manager.fixed_key          = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.barbican_api_version  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.barbican_endpoint     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.barbican_endpoint_type = public {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.barbican_region_name  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.cafile                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.certfile              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.collect_timing        = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.insecure              = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.keyfile               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.number_of_retries     = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.retry_delay           = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.send_service_user_token = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.split_loggers         = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.timeout               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.verify_ssl            = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican.verify_ssl_path       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.auth_section = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.auth_type = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.cafile   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.certfile = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.collect_timing = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.insecure = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.keyfile  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.split_loggers = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] barbican_service_user.timeout  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.approle_role_id          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.approle_secret_id        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.cafile                   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.certfile                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.collect_timing           = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.insecure                 = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.keyfile                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.kv_mountpoint            = secret {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.kv_path                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.kv_version               = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.namespace                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.root_token_id            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.split_loggers            = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.ssl_ca_crt_file          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.timeout                  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.use_ssl                  = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.auth_section          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.auth_type             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.cafile                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.certfile              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.collect_timing        = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.connect_retries       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.connect_retry_delay   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.endpoint_override     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.insecure              = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.keyfile               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.max_version           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.min_version           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.region_name           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.service_name          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.service_type          = identity {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.split_loggers         = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.status_code_retries   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.status_code_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.timeout               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] keystone.version               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.connection_uri         =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.cpu_mode               = custom {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: WARNING oslo_config.cfg [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.cpu_power_governor_high = performance {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.cpu_power_management   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.device_detach_attempts = 8 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.device_detach_timeout  = 20 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.disk_cachemodes        = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.disk_prefix            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.enabled_perf_events    = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.file_backed_memory     = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.gid_maps               = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.hw_disk_discard        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.hw_machine_type        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.images_rbd_pool        = rbd {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.images_type            = default {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.images_volume_group    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.inject_key             = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.inject_partition       = -2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.inject_password        = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.iscsi_iface            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.iser_use_multipath     = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_downtime = 500 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_inbound_addr = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_scheme  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_timeout_action = abort {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_tunnelled = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: WARNING oslo_config.cfg [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 11:02:18 user nova-compute[75255]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 11:02:18 user nova-compute[75255]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 11:02:18 user nova-compute[75255]: and ``live_migration_inbound_addr`` respectively.
Nov 14 11:02:18 user nova-compute[75255]: ).  Its value may be silently ignored in the future.
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.live_migration_with_native_tls = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.max_queues             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.nfs_mount_options      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.num_pcie_ports         = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.pmem_namespaces        = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.quobyte_client_cfg     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rbd_secret_uuid        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rbd_user               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rescue_image_id        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rescue_kernel_id       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.rx_queue_size          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.smbfs_mount_options    =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.snapshot_compression   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.snapshot_image_format  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.sparse_logical_volumes = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.swtpm_enabled          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.swtpm_group            = tss {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.swtpm_user             = tss {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.sysinfo_serial         = unique {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.tb_cache_size          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.tx_queue_size          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.uid_maps               = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.use_virtio_for_bridges = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.virt_type              = kvm {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.volume_clear           = zero {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.volume_clear_size      = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.volume_use_multipath   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.vzstorage_cache_path   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.auth_section           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.auth_type              = password {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.cafile                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.certfile               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.collect_timing         = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.connect_retries        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.connect_retry_delay    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.default_floating_pool  = public {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.endpoint_override      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.extension_sync_interval = 600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.http_retries           = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.insecure               = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.keyfile                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.max_version            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.min_version            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.ovs_bridge             = br-int {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.physnets               = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.region_name            = RegionOne {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.service_metadata_proxy = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.service_name           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.service_type           = network {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.split_loggers          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.status_code_retries    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.status_code_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.timeout                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] neutron.version                = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] notifications.bdms_in_notifications = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] notifications.default_level    = INFO {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] notifications.notification_format = unversioned {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] notifications.notify_on_state_change = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] pci.alias                      = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] pci.device_spec                = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] pci.report_in_placement        = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.auth_section         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.auth_type            = password {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.cafile               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.certfile             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.collect_timing       = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.connect_retries      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.connect_retry_delay  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.default_domain_id    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.default_domain_name  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.domain_id            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.domain_name          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.endpoint_override    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.insecure             = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.keyfile              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.max_version          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.min_version          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.password             = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.project_domain_id    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.project_domain_name  = Default {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.project_id           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.project_name         = service {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.region_name          = RegionOne {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.service_name         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.service_type         = placement {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.split_loggers        = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.status_code_retries  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.status_code_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.system_scope         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.timeout              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.trust_id             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.user_domain_id       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.user_domain_name     = Default {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.user_id              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.username             = placement {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] placement.version              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.cores                    = 20 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.count_usage_from_placement = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.injected_file_content_bytes = 10240 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.injected_file_path_length = 255 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.injected_files           = 5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.instances                = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.key_pairs                = 100 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.metadata_items           = 128 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.ram                      = 51200 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.recheck_quota            = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.server_group_members     = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] quota.server_groups            = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rdp.enabled                    = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.image_metadata_prefilter = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.max_attempts         = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.max_placement_results = 1000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] scheduler.workers              = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.host_subset_size = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.isolated_hosts = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.isolated_images = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.pci_in_placement = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.track_instance_changes = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] metrics.required               = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] metrics.weight_multiplier      = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] metrics.weight_setting         = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] serial_console.enabled         = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] serial_console.port_range      = 10000:20000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] serial_console.serialproxy_port = 6083 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.auth_section      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.auth_type         = password {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.cafile            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.certfile          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.collect_timing    = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.insecure          = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.keyfile           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.send_service_user_token = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.split_loggers     = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] service_user.timeout           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.agent_enabled            = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.enabled                  = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.html5proxy_port          = 6082 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.image_compression        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.jpeg_compression         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.playback_compression     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.server_listen            = 127.0.0.1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.streaming_mode           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] spice.zlib_compression         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] upgrade_levels.baseapi         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] upgrade_levels.cert            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] upgrade_levels.compute         = auto {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] upgrade_levels.conductor       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] upgrade_levels.scheduler       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.cafile = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.certfile = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.insecure = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vendordata_dynamic_auth.timeout = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.api_retry_count         = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.ca_file                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.cache_prefix            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.cluster_name            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.connection_pool_size    = 10 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.console_delay_seconds   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.datastore_regex         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.host_ip                 = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.host_password           = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.host_port               = 443 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.host_username           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.insecure                = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.integration_bridge      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.maximum_objects         = 100 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.pbm_default_policy      = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.pbm_enabled             = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.pbm_wsdl_location       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.serial_port_proxy_uri   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.serial_port_service_uri = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.task_poll_interval      = 0.5 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.use_linked_clone        = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.vnc_keymap              = en-us {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.vnc_port                = 5900 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vmware.vnc_port_total          = 10000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.auth_schemes               = ['none'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.enabled                    = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.novncproxy_port            = 6080 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.vencrypt_ca_certs          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.vencrypt_client_cert       = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vnc.vencrypt_client_key        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.disable_rootwrap   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.enable_numa_live_migration = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.libvirt_disable_apic = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.client_socket_timeout     = 900 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.default_pool_size         = 1000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.keep_alive                = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.max_header_line           = 16384 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.ssl_ca_file               = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.ssl_cert_file             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.ssl_key_file              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.tcp_keepidle              = 600 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] zvm.ca_file                    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] zvm.cloud_connector_url        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] zvm.reachable_timeout          = 300 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.enforce_new_defaults = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.enforce_scope      = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.policy_default_rule = default {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.connection_string     = messaging:// {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.enabled               = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.es_doc_type           = notification {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.es_scroll_size        = 10000 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.es_scroll_time        = 2m {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.filter_error_trace    = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.hmac_keys             = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.sentinel_service_name = mymaster {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.socket_timeout        = 0.1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.trace_requests        = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler.trace_sqlalchemy      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler_jaeger.process_tags   = {} {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler_jaeger.service_name_prefix = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] profiler_otlp.service_name_prefix = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] remote_debug.host              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] remote_debug.port              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_notifications.retry = -1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.auth_section        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.auth_type           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.cafile              = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.certfile            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.collect_timing      = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.connect_retries     = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.connect_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.endpoint_id         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.endpoint_override   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.insecure            = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.keyfile             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.max_version         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.min_version         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.region_name         = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.service_name        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.service_type        = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.split_loggers       = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.status_code_retries = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.status_code_retry_delay = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.timeout             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.valid_interfaces    = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_limit.version             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_reports.file_event_handler = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] oslo_reports.log_dir           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_ovs_privileged.group  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] vif_plug_ovs_privileged.user   = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_ovs.isolate_vif         = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] os_brick.lock_path             = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] privsep_osbrick.capabilities   = [21] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] privsep_osbrick.group          = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] privsep_osbrick.helper_command = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] privsep_osbrick.user           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] nova_sys_admin.group           = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] nova_sys_admin.helper_command  = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] nova_sys_admin.user            = None {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG oslo_service.service [None req-2ee3214c-e33a-4505-89e9-71f209a73779 None None] ******************************************************************************** {{(pid=75255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 11:02:18 user nova-compute[75255]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 11:02:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Connecting to libvirt: qemu:///system {{(pid=75255) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff339db6fe0> {{(pid=75255) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 11:02:18 user nova-compute[75255]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 11:02:18 user nova-compute[75255]: WARNING nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 11:02:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff339db6fe0> {{(pid=75255) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Starting native event thread {{(pid=75255) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Starting green dispatch thread {{(pid=75255) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 11:02:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Starting connection event dispatch thread {{(pid=75255) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 11:02:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Connection event '1' reason 'None'
Nov 14 11:02:18 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 11:02:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.mount [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Initialising _HostMountState generation 0 {{(pid=75255) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 11:02:26 user nova-compute[75255]: INFO nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host capabilities <capabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <host>
Nov 14 11:02:26 user nova-compute[75255]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 11:02:26 user nova-compute[75255]:     <cpu>
Nov 14 11:02:26 user nova-compute[75255]:       <arch>x86_64</arch>
Nov 14 11:02:26 user nova-compute[75255]:       <model>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <microcode version='1070'/>
Nov 14 11:02:26 user nova-compute[75255]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 11:02:26 user nova-compute[75255]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='osxsave'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='invtsc'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='rsba'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 11:02:26 user nova-compute[75255]:       <pages unit='KiB' size='4'/>
Nov 14 11:02:26 user nova-compute[75255]:       <pages unit='KiB' size='2048'/>
Nov 14 11:02:26 user nova-compute[75255]:     </cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <power_management>
Nov 14 11:02:26 user nova-compute[75255]:       <suspend_mem/>
Nov 14 11:02:26 user nova-compute[75255]:       <suspend_disk/>
Nov 14 11:02:26 user nova-compute[75255]:       <suspend_hybrid/>
Nov 14 11:02:26 user nova-compute[75255]:     </power_management>
Nov 14 11:02:26 user nova-compute[75255]:     <iommu support='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <migration_features>
Nov 14 11:02:26 user nova-compute[75255]:       <live/>
Nov 14 11:02:26 user nova-compute[75255]:       <uri_transports>
Nov 14 11:02:26 user nova-compute[75255]:         <uri_transport>tcp</uri_transport>
Nov 14 11:02:26 user nova-compute[75255]:         <uri_transport>rdma</uri_transport>
Nov 14 11:02:26 user nova-compute[75255]:       </uri_transports>
Nov 14 11:02:26 user nova-compute[75255]:     </migration_features>
Nov 14 11:02:26 user nova-compute[75255]:     <topology>
Nov 14 11:02:26 user nova-compute[75255]:       <cells num='2'>
Nov 14 11:02:26 user nova-compute[75255]:         <cell id='0'>
Nov 14 11:02:26 user nova-compute[75255]:           <memory unit='KiB'>8140616</memory>
Nov 14 11:02:26 user nova-compute[75255]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 11:02:26 user nova-compute[75255]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 11:02:26 user nova-compute[75255]:           <distances>
Nov 14 11:02:26 user nova-compute[75255]:             <sibling id='0' value='10'/>
Nov 14 11:02:26 user nova-compute[75255]:             <sibling id='1' value='20'/>
Nov 14 11:02:26 user nova-compute[75255]:           </distances>
Nov 14 11:02:26 user nova-compute[75255]:           <cpus num='6'>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 11:02:26 user nova-compute[75255]:           </cpus>
Nov 14 11:02:26 user nova-compute[75255]:         </cell>
Nov 14 11:02:26 user nova-compute[75255]:         <cell id='1'>
Nov 14 11:02:26 user nova-compute[75255]:           <memory unit='KiB'>8255100</memory>
Nov 14 11:02:26 user nova-compute[75255]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 14 11:02:26 user nova-compute[75255]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 11:02:26 user nova-compute[75255]:           <distances>
Nov 14 11:02:26 user nova-compute[75255]:             <sibling id='0' value='20'/>
Nov 14 11:02:26 user nova-compute[75255]:             <sibling id='1' value='10'/>
Nov 14 11:02:26 user nova-compute[75255]:           </distances>
Nov 14 11:02:26 user nova-compute[75255]:           <cpus num='6'>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 11:02:26 user nova-compute[75255]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 11:02:26 user nova-compute[75255]:           </cpus>
Nov 14 11:02:26 user nova-compute[75255]:         </cell>
Nov 14 11:02:26 user nova-compute[75255]:       </cells>
Nov 14 11:02:26 user nova-compute[75255]:     </topology>
Nov 14 11:02:26 user nova-compute[75255]:     <cache>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 11:02:26 user nova-compute[75255]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 11:02:26 user nova-compute[75255]:     </cache>
Nov 14 11:02:26 user nova-compute[75255]:     <secmodel>
Nov 14 11:02:26 user nova-compute[75255]:       <model>apparmor</model>
Nov 14 11:02:26 user nova-compute[75255]:       <doi>0</doi>
Nov 14 11:02:26 user nova-compute[75255]:     </secmodel>
Nov 14 11:02:26 user nova-compute[75255]:     <secmodel>
Nov 14 11:02:26 user nova-compute[75255]:       <model>dac</model>
Nov 14 11:02:26 user nova-compute[75255]:       <doi>0</doi>
Nov 14 11:02:26 user nova-compute[75255]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 11:02:26 user nova-compute[75255]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 11:02:26 user nova-compute[75255]:     </secmodel>
Nov 14 11:02:26 user nova-compute[75255]:   </host>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='alpha'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>clipper</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='armv6l'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>spitz</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>nuri</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>kzm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sx1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>z2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>tosa</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>n810</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>n800</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>terrier</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>midway</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>microbit</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>verdex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>highbank</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>akita</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>connex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>collie</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='armv7l'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>spitz</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>nuri</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>kzm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sx1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>z2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>tosa</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>n810</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>n800</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>terrier</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>midway</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>microbit</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>verdex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>highbank</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>akita</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>connex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>collie</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='aarch64'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>spitz</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>nuri</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>kzm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sx1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>z2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>tosa</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>n810</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>n800</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>terrier</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>midway</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>microbit</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>verdex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>highbank</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>akita</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>connex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>collie</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <acpi default='on' toggle='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='cris'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='i686'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>isapc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>microvm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='kvm'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <pae/>
Nov 14 11:02:26 user nova-compute[75255]:       <nonpae/>
Nov 14 11:02:26 user nova-compute[75255]:       <acpi default='on' toggle='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:       <apic default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='m68k'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>an5206</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>q800</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='microblaze'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='microblazeel'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='mips'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='16'>malta</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='mipsel'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='16'>malta</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='mips64'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='16'>malta</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>pica61</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>magnum</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='mips64el'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='16'>malta</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>pica61</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>magnum</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='16'>boston</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='ppc'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mac99</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>40p</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>taihu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='ppc64'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>taihu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>40p</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mac99</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='ppc64le'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>taihu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>40p</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>mac99</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='riscv32'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='8'>spike</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='8'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='riscv64'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='8'>spike</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='8'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='s390x'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='sh4'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>shix</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>r2d</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='sh4eb'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>shix</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>r2d</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='sparc'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>LX</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='sparc64'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>niagara</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='x86_64'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>64</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='1'>isapc</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>microvm</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='kvm'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <acpi default='on' toggle='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:       <apic default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='xtensa'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>sim</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>kc705</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>ml605</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx200</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx60</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]:   <guest>
Nov 14 11:02:26 user nova-compute[75255]:     <os_type>hvm</os_type>
Nov 14 11:02:26 user nova-compute[75255]:     <arch name='xtensaeb'>
Nov 14 11:02:26 user nova-compute[75255]:       <wordsize>32</wordsize>
Nov 14 11:02:26 user nova-compute[75255]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='4'>sim</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>kc705</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>ml605</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>virt</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx200</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>lx60</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 11:02:26 user nova-compute[75255]:       <domain type='qemu'/>
Nov 14 11:02:26 user nova-compute[75255]:     </arch>
Nov 14 11:02:26 user nova-compute[75255]:     <features>
Nov 14 11:02:26 user nova-compute[75255]:       <cpuselection/>
Nov 14 11:02:26 user nova-compute[75255]:       <deviceboot/>
Nov 14 11:02:26 user nova-compute[75255]:       <disksnapshot default='on' toggle='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     </features>
Nov 14 11:02:26 user nova-compute[75255]:   </guest>
Nov 14 11:02:26 user nova-compute[75255]: </capabilities>
Nov 14 11:02:26 user nova-compute[75255]: 
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-q35-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>i686</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='288'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'/>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='lm'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-q35-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>i686</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='288'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'/>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='lm'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-i440fx-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>i686</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='255'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'/>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='lm'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ide</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-i440fx-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>i686</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='255'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'/>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='lm'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ide</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-q35-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>x86_64</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='288'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>efi</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='invtsc'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='rsba'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-q35-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>x86_64</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='288'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>efi</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='invtsc'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='rsba'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-i440fx-6.2</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>x86_64</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='255'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>efi</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='invtsc'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='rsba'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ide</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 11:02:26 user nova-compute[75255]: <domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 11:02:26 user nova-compute[75255]:   <domain>kvm</domain>
Nov 14 11:02:26 user nova-compute[75255]:   <machine>pc-i440fx-jammy</machine>
Nov 14 11:02:26 user nova-compute[75255]:   <arch>x86_64</arch>
Nov 14 11:02:26 user nova-compute[75255]:   <vcpu max='255'/>
Nov 14 11:02:26 user nova-compute[75255]:   <iothreads supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:   <os supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='firmware'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>efi</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:     <loader supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>rom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pflash</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='readonly'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>yes</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='secure'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>no</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </loader>
Nov 14 11:02:26 user nova-compute[75255]:   </os>
Nov 14 11:02:26 user nova-compute[75255]:   <cpu>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-passthrough' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='hostPassthroughMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='maximum' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='maximumMigratable'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>on</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>off</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='host-model' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <vendor>Intel</vendor>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ss'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='vmx'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pcid'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='hypervisor'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arat'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='umip'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='md-clear'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='invtsc'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibpb'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='ibrs'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-stibp'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='rsba'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='erms'/>
Nov 14 11:02:26 user nova-compute[75255]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:     <mode name='custom' supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>qemu64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>qemu32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>phenom</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>pentium</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>n270</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm64</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>kvm32</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>coreduo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>core2duo</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>athlon</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Westmere</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Snowridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Skylake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>SandyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Penryn</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G5</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G4</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G3</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Opteron_G2</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Opteron_G1</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>IvyBridge</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Icelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Haswell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Rome</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-Milan</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>EPYC</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Dhyana</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cooperlake</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>Conroe</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='no'>Broadwell</model>
Nov 14 11:02:26 user nova-compute[75255]:       <model usable='yes'>486</model>
Nov 14 11:02:26 user nova-compute[75255]:     </mode>
Nov 14 11:02:26 user nova-compute[75255]:   </cpu>
Nov 14 11:02:26 user nova-compute[75255]:   <memoryBacking supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:     <enum name='sourceType'>
Nov 14 11:02:26 user nova-compute[75255]:       <value>file</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>anonymous</value>
Nov 14 11:02:26 user nova-compute[75255]:       <value>memfd</value>
Nov 14 11:02:26 user nova-compute[75255]:     </enum>
Nov 14 11:02:26 user nova-compute[75255]:   </memoryBacking>
Nov 14 11:02:26 user nova-compute[75255]:   <devices>
Nov 14 11:02:26 user nova-compute[75255]:     <disk supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='diskDevice'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>disk</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cdrom</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>floppy</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>lun</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='bus'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ide</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>fdc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sata</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </disk>
Nov 14 11:02:26 user nova-compute[75255]:     <graphics supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='type'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>sdl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vnc</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>spice</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egl-headless</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </graphics>
Nov 14 11:02:26 user nova-compute[75255]:     <video supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='modelType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>cirrus</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>vmvga</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>qxl</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>none</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>bochs</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>ramfb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </video>
Nov 14 11:02:26 user nova-compute[75255]:     <hostdev supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='mode'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>subsystem</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='startupPolicy'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>default</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>mandatory</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>requisite</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>optional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='subsysType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>usb</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>pci</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>scsi</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='capsType'/>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='pciBackend'/>
Nov 14 11:02:26 user nova-compute[75255]:     </hostdev>
Nov 14 11:02:26 user nova-compute[75255]:     <rng supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtio-non-transitional</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>random</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>egd</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>builtin</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </rng>
Nov 14 11:02:26 user nova-compute[75255]:     <filesystem supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='driverType'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>path</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>handle</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>virtiofs</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </filesystem>
Nov 14 11:02:26 user nova-compute[75255]:     <tpm supported='yes'>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='model'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-tis</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>tpm-crb</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:       <enum name='backendModel'>
Nov 14 11:02:26 user nova-compute[75255]:         <value>passthrough</value>
Nov 14 11:02:26 user nova-compute[75255]:         <value>emulator</value>
Nov 14 11:02:26 user nova-compute[75255]:       </enum>
Nov 14 11:02:26 user nova-compute[75255]:     </tpm>
Nov 14 11:02:26 user nova-compute[75255]:   </devices>
Nov 14 11:02:26 user nova-compute[75255]:   <features>
Nov 14 11:02:26 user nova-compute[75255]:     <gic supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:     <vmcoreinfo supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <genid supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backingStoreInput supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <backup supported='yes'/>
Nov 14 11:02:26 user nova-compute[75255]:     <sev supported='no'/>
Nov 14 11:02:26 user nova-compute[75255]:   </features>
Nov 14 11:02:26 user nova-compute[75255]: </domainCapabilities>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75255) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75255) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Checking secure boot support for host arch (x86_64) {{(pid=75255) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 11:02:26 user nova-compute[75255]: INFO nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Secure Boot support detected
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] cpu compare xml: <cpu match="exact">
Nov 14 11:02:26 user nova-compute[75255]:   <model>Nehalem</model>
Nov 14 11:02:26 user nova-compute[75255]: </cpu>
Nov 14 11:02:26 user nova-compute[75255]:  {{(pid=75255) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 11:02:26 user nova-compute[75255]: INFO nova.virt.node [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Generated node identity f0f4b442-5a89-43dd-b8f0-d063e03c0c97
Nov 14 11:02:26 user nova-compute[75255]: INFO nova.virt.node [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Wrote node identity f0f4b442-5a89-43dd-b8f0-d063e03c0c97 to /opt/stack/data/nova/compute_id
Nov 14 11:02:26 user nova-compute[75255]: WARNING nova.compute.manager [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Compute nodes ['f0f4b442-5a89-43dd-b8f0-d063e03c0c97'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 11:02:26 user nova-compute[75255]: INFO nova.compute.manager [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 11:02:26 user nova-compute[75255]: WARNING nova.compute.manager [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 11:02:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:02:26 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:02:26 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Hypervisor/Node resource view: name=user free_ram=11002MB free_disk=26.117023468017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:02:26 user nova-compute[75255]: WARNING nova.compute.resource_tracker [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] No compute node record for user:f0f4b442-5a89-43dd-b8f0-d063e03c0c97: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f0f4b442-5a89-43dd-b8f0-d063e03c0c97 could not be found.
Nov 14 11:02:26 user nova-compute[75255]: INFO nova.compute.resource_tracker [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Compute node record created for user:user with uuid: f0f4b442-5a89-43dd-b8f0-d063e03c0c97
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:02:26 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:02:27 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] [req-9dd322bd-e2ee-4a58-8c03-b446f64d64c4] Created resource provider record via placement API for resource provider with UUID f0f4b442-5a89-43dd-b8f0-d063e03c0c97 and name user.
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75255) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 11:02:27 user nova-compute[75255]: INFO nova.virt.libvirt.host [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] kernel doesn't support AMD SEV
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Libvirt baseline CPU <cpu>
Nov 14 11:02:27 user nova-compute[75255]:   <arch>x86_64</arch>
Nov 14 11:02:27 user nova-compute[75255]:   <model>Nehalem</model>
Nov 14 11:02:27 user nova-compute[75255]:   <vendor>Intel</vendor>
Nov 14 11:02:27 user nova-compute[75255]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 11:02:27 user nova-compute[75255]: </cpu>
Nov 14 11:02:27 user nova-compute[75255]:  {{(pid=75255) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Updated inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Updating resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 generation from 0 to 1 during operation: update_inventory {{(pid=75255) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Updating resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 generation from 1 to 2 during operation: update_traits {{(pid=75255) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.service [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Creating RPC server for service compute {{(pid=75255) start /opt/stack/nova/nova/service.py:182}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.service [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] Join ServiceGroup membership for this service compute {{(pid=75255) start /opt/stack/nova/nova/service.py:199}}
Nov 14 11:02:27 user nova-compute[75255]: DEBUG nova.servicegroup.drivers.db [None req-44d74b4c-d09b-404a-aaaa-720666178c8d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75255) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 11:02:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_power_states {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:02:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:03:18 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:03:18 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=10463MB free_disk=26.02069091796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:03:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:04:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:04:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:04:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:04:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:04:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:04:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:04:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:04:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=10381MB free_disk=26.077789306640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:04:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:05:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:05:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:05:21 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:05:21 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=10407MB free_disk=25.837459564208984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:05:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:06:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:06:22 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:22 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:22 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9678MB free_disk=25.856582641601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:06:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:06:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:06:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:06:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:06:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:06:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:06:24 user nova-compute[75255]: INFO nova.compute.claims [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Claim successful on node user
Nov 14 11:06:24 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:06:24 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:06:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:06:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:06:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Creating image(s)
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "66031f17-4225-4c50-bd18-3df496586023" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG nova.policy [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c7ed01376d41ac9b99ba698909e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a3c374e68a4ec483ff0a15298b1bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:06:26 user nova-compute[75255]: INFO nova.compute.claims [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Claim successful on node user
Nov 14 11:06:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.part --force-share --output=json" returned: 0 in 0.230s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG nova.virt.images [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] 26cc9ab5-432f-4182-801c-11cab6c13c7e was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:06:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.part /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.part /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.converted" returned: 0 in 0.310s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.773s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:27 user nova-compute[75255]: INFO oslo.privsep.daemon [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpwk79wucr/privsep.sock']
Nov 14 11:06:27 user sudo[84502]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpwk79wucr/privsep.sock
Nov 14 11:06:27 user sudo[84502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.network.neutron [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:06:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:06:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Creating image(s)
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG nova.policy [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c7ed01376d41ac9b99ba698909e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a3c374e68a4ec483ff0a15298b1bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:06:28 user nova-compute[75255]: INFO nova.compute.claims [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Claim successful on node user
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.network.neutron [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:06:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:06:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Creating image(s)
Nov 14 11:06:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.policy [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6cafcd6055544bcbd86f3015db594f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3a9d5daf4b497a8a85e435e91f1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:06:28 user sudo[84502]: pam_unix(sudo:session): session closed for user root
Nov 14 11:06:28 user nova-compute[75255]: INFO oslo.privsep.daemon [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Spawned new privsep daemon via rootwrap
Nov 14 11:06:28 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 11:06:28 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 11:06:28 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 11:06:28 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84507
Nov 14 11:06:28 user nova-compute[75255]: WARNING oslo_privsep.priv_context [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] privsep daemon already running
Nov 14 11:06:28 user nova-compute[75255]: WARNING oslo_privsep.priv_context [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] privsep daemon already running
Nov 14 11:06:28 user nova-compute[75255]: DEBUG nova.network.neutron [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Successfully created port: 7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.203s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.269s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.265s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG nova.network.neutron [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Successfully created port: 10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.203s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk 1073741824" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.405s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.409s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk 1073741824" returned: 0 in 0.045s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.604s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Cannot resize image /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Ensure instance console log exists: /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.191s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk 1073741824" returned: 0 in 0.050s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Cannot resize image /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Ensure instance console log exists: /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Cannot resize image /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Ensure instance console log exists: /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:31 user nova-compute[75255]: DEBUG nova.network.neutron [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Successfully created port: 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Successfully updated port: 7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Successfully updated port: 10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-changed-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Refreshing instance network info cache due to event network-changed-7853a5a2-5301-4337-a5a4-6bcddf944f11. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] Acquiring lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-changed-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Refreshing instance network info cache due to event network-changed-10813fe9-0bbf-4535-87ea-34769197f996. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:06:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] Acquiring lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance network_info: |[{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] Acquired lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.neutron [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Refreshing network info cache for port 7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Start _get_guest_xml network_info=[{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:06:33 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:33 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461046809',display_name='tempest-ServerRescueNegativeTestJSON-server-1461046809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461046809',id=1,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-yvdv1q6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:25Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=943d1e23-bb99-4499-83db-eca996c3fedf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.objects.instance [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'pci_devices' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:06:33 user nova-compute[75255]:   <uuid>943d1e23-bb99-4499-83db-eca996c3fedf</uuid>
Nov 14 11:06:33 user nova-compute[75255]:   <name>instance-00000001</name>
Nov 14 11:06:33 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:06:33 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:06:33 user nova-compute[75255]:   <metadata>
Nov 14 11:06:33 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:06:33 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1461046809</nova:name>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:06:33</nova:creationTime>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:06:33 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:06:33 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:owner>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:user uuid="13c7ed01376d41ac9b99ba698909e8bf">tempest-ServerRescueNegativeTestJSON-2135406154-project-member</nova:user>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:project uuid="e4a3c374e68a4ec483ff0a15298b1bff">tempest-ServerRescueNegativeTestJSON-2135406154</nova:project>
Nov 14 11:06:33 user nova-compute[75255]:       </nova:owner>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:ports>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:port uuid="7853a5a2-5301-4337-a5a4-6bcddf944f11">
Nov 14 11:06:33 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:06:33 user nova-compute[75255]:         </nova:port>
Nov 14 11:06:33 user nova-compute[75255]:       </nova:ports>
Nov 14 11:06:33 user nova-compute[75255]:     </nova:instance>
Nov 14 11:06:33 user nova-compute[75255]:   </metadata>
Nov 14 11:06:33 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:06:33 user nova-compute[75255]:     <system>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="serial">943d1e23-bb99-4499-83db-eca996c3fedf</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="uuid">943d1e23-bb99-4499-83db-eca996c3fedf</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:06:33 user nova-compute[75255]:     </system>
Nov 14 11:06:33 user nova-compute[75255]:   </sysinfo>
Nov 14 11:06:33 user nova-compute[75255]:   <os>
Nov 14 11:06:33 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:06:33 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:06:33 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:06:33 user nova-compute[75255]:   </os>
Nov 14 11:06:33 user nova-compute[75255]:   <features>
Nov 14 11:06:33 user nova-compute[75255]:     <acpi/>
Nov 14 11:06:33 user nova-compute[75255]:     <apic/>
Nov 14 11:06:33 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:06:33 user nova-compute[75255]:   </features>
Nov 14 11:06:33 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:06:33 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:06:33 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:06:33 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:06:33 user nova-compute[75255]:   </clock>
Nov 14 11:06:33 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:06:33 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:06:33 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:06:33 user nova-compute[75255]:   </cpu>
Nov 14 11:06:33 user nova-compute[75255]:   <devices>
Nov 14 11:06:33 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:06:33 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:06:33 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk"/>
Nov 14 11:06:33 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:06:33 user nova-compute[75255]:     </disk>
Nov 14 11:06:33 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:06:33 user nova-compute[75255]:       <mac address="fa:16:3e:f7:c9:63"/>
Nov 14 11:06:33 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:33 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:06:33 user nova-compute[75255]:       <target dev="tap7853a5a2-53"/>
Nov 14 11:06:33 user nova-compute[75255]:     </interface>
Nov 14 11:06:33 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:06:33 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/console.log" append="off"/>
Nov 14 11:06:33 user nova-compute[75255]:     </serial>
Nov 14 11:06:33 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:06:33 user nova-compute[75255]:     <video>
Nov 14 11:06:33 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:33 user nova-compute[75255]:     </video>
Nov 14 11:06:33 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:06:33 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:06:33 user nova-compute[75255]:     </rng>
Nov 14 11:06:33 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:06:33 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:06:33 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:06:33 user nova-compute[75255]:     </memballoon>
Nov 14 11:06:33 user nova-compute[75255]:   </devices>
Nov 14 11:06:33 user nova-compute[75255]: </domain>
Nov 14 11:06:33 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461046809',display_name='tempest-ServerRescueNegativeTestJSON-server-1461046809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461046809',id=1,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-yvdv1q6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:25Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=943d1e23-bb99-4499-83db-eca996c3fedf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG os_vif [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Created schema index Interface.name {{(pid=75255) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Created schema index Port.name {{(pid=75255) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Created schema index Bridge.name {{(pid=75255) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [POLLOUT] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updating instance_info_cache with network_info: [{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0722510d-a4e3-5cb5-9c0e-b98f1769e9e8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:33 user nova-compute[75255]: INFO oslo.privsep.daemon [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpizglakrd/privsep.sock']
Nov 14 11:06:33 user sudo[84567]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpizglakrd/privsep.sock
Nov 14 11:06:33 user sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 11:06:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance network_info: |[{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] Acquired lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.neutron [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Refreshing network info cache for port 10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Start _get_guest_xml network_info=[{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:06:33 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:33 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Successfully updated port: 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1506170198',display_name='tempest-ServerRescueNegativeTestJSON-server-1506170198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1506170198',id=2,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-wdlro802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:27Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=66031f17-4225-4c50-bd18-3df496586023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.objects.instance [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'pci_devices' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:06:33 user nova-compute[75255]:   <uuid>66031f17-4225-4c50-bd18-3df496586023</uuid>
Nov 14 11:06:33 user nova-compute[75255]:   <name>instance-00000002</name>
Nov 14 11:06:33 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:06:33 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:06:33 user nova-compute[75255]:   <metadata>
Nov 14 11:06:33 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:06:33 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1506170198</nova:name>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:06:33</nova:creationTime>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:06:33 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:06:33 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:owner>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:user uuid="13c7ed01376d41ac9b99ba698909e8bf">tempest-ServerRescueNegativeTestJSON-2135406154-project-member</nova:user>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:project uuid="e4a3c374e68a4ec483ff0a15298b1bff">tempest-ServerRescueNegativeTestJSON-2135406154</nova:project>
Nov 14 11:06:33 user nova-compute[75255]:       </nova:owner>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:06:33 user nova-compute[75255]:       <nova:ports>
Nov 14 11:06:33 user nova-compute[75255]:         <nova:port uuid="10813fe9-0bbf-4535-87ea-34769197f996">
Nov 14 11:06:33 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 11:06:33 user nova-compute[75255]:         </nova:port>
Nov 14 11:06:33 user nova-compute[75255]:       </nova:ports>
Nov 14 11:06:33 user nova-compute[75255]:     </nova:instance>
Nov 14 11:06:33 user nova-compute[75255]:   </metadata>
Nov 14 11:06:33 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:06:33 user nova-compute[75255]:     <system>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="serial">66031f17-4225-4c50-bd18-3df496586023</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="uuid">66031f17-4225-4c50-bd18-3df496586023</entry>
Nov 14 11:06:33 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:06:33 user nova-compute[75255]:     </system>
Nov 14 11:06:33 user nova-compute[75255]:   </sysinfo>
Nov 14 11:06:33 user nova-compute[75255]:   <os>
Nov 14 11:06:33 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:06:33 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:06:33 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:06:33 user nova-compute[75255]:   </os>
Nov 14 11:06:33 user nova-compute[75255]:   <features>
Nov 14 11:06:33 user nova-compute[75255]:     <acpi/>
Nov 14 11:06:33 user nova-compute[75255]:     <apic/>
Nov 14 11:06:33 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:06:33 user nova-compute[75255]:   </features>
Nov 14 11:06:33 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:06:33 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:06:33 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:06:33 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:06:33 user nova-compute[75255]:   </clock>
Nov 14 11:06:33 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:06:33 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:06:33 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:06:33 user nova-compute[75255]:   </cpu>
Nov 14 11:06:33 user nova-compute[75255]:   <devices>
Nov 14 11:06:33 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:06:33 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:06:33 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk"/>
Nov 14 11:06:33 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:06:33 user nova-compute[75255]:     </disk>
Nov 14 11:06:33 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:06:33 user nova-compute[75255]:       <mac address="fa:16:3e:da:f5:ff"/>
Nov 14 11:06:33 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:33 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:06:33 user nova-compute[75255]:       <target dev="tap10813fe9-0b"/>
Nov 14 11:06:33 user nova-compute[75255]:     </interface>
Nov 14 11:06:33 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:06:33 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/console.log" append="off"/>
Nov 14 11:06:33 user nova-compute[75255]:     </serial>
Nov 14 11:06:33 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:06:33 user nova-compute[75255]:     <video>
Nov 14 11:06:33 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:33 user nova-compute[75255]:     </video>
Nov 14 11:06:33 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:06:33 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:06:33 user nova-compute[75255]:     </rng>
Nov 14 11:06:33 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:06:33 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:06:33 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:06:33 user nova-compute[75255]:     </memballoon>
Nov 14 11:06:33 user nova-compute[75255]:   </devices>
Nov 14 11:06:33 user nova-compute[75255]: </domain>
Nov 14 11:06:33 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1506170198',display_name='tempest-ServerRescueNegativeTestJSON-server-1506170198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1506170198',id=2,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-wdlro802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:27Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=66031f17-4225-4c50-bd18-3df496586023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG os_vif [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce1af509-c9cc-5979-8023-539fa171a04a', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:06:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-changed-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Refreshing instance network info cache due to event network-changed-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:06:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updated VIF entry in instance network info cache for port 7853a5a2-5301-4337-a5a4-6bcddf944f11. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:06:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-63f56cca-4ce0-40d5-86c1-91789f326620 req-457f8285-4b3a-4e58-b33c-0280a24f8678 service nova] Releasing lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance network_info: |[{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.neutron [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Refreshing network info cache for port 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Start _get_guest_xml network_info=[{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:06:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lazy-loading 'pci_devices' on Instance uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:06:35 user nova-compute[75255]:   <uuid>26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</uuid>
Nov 14 11:06:35 user nova-compute[75255]:   <name>instance-00000003</name>
Nov 14 11:06:35 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:06:35 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:06:35 user nova-compute[75255]:   <metadata>
Nov 14 11:06:35 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:06:35 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:06:35 user nova-compute[75255]:       <nova:name>tempest-ServerActionsTestOtherB-server-1199255564</nova:name>
Nov 14 11:06:35 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:06:35</nova:creationTime>
Nov 14 11:06:35 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:06:35 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:06:35 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:06:35 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:06:35 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:06:35 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:06:35 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:06:35 user nova-compute[75255]:       <nova:owner>
Nov 14 11:06:35 user nova-compute[75255]:         <nova:user uuid="a6cafcd6055544bcbd86f3015db594f2">tempest-ServerActionsTestOtherB-1009587932-project-member</nova:user>
Nov 14 11:06:35 user nova-compute[75255]:         <nova:project uuid="7b3a9d5daf4b497a8a85e435e91f1727">tempest-ServerActionsTestOtherB-1009587932</nova:project>
Nov 14 11:06:35 user nova-compute[75255]:       </nova:owner>
Nov 14 11:06:35 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:06:35 user nova-compute[75255]:       <nova:ports>
Nov 14 11:06:35 user nova-compute[75255]:         <nova:port uuid="8730dcdf-d2cb-4be1-aa6a-299cb1b955bf">
Nov 14 11:06:35 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:06:35 user nova-compute[75255]:         </nova:port>
Nov 14 11:06:35 user nova-compute[75255]:       </nova:ports>
Nov 14 11:06:35 user nova-compute[75255]:     </nova:instance>
Nov 14 11:06:35 user nova-compute[75255]:   </metadata>
Nov 14 11:06:35 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:06:35 user nova-compute[75255]:     <system>
Nov 14 11:06:35 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:06:35 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:06:35 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:06:35 user nova-compute[75255]:       <entry name="serial">26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</entry>
Nov 14 11:06:35 user nova-compute[75255]:       <entry name="uuid">26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</entry>
Nov 14 11:06:35 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:06:35 user nova-compute[75255]:     </system>
Nov 14 11:06:35 user nova-compute[75255]:   </sysinfo>
Nov 14 11:06:35 user nova-compute[75255]:   <os>
Nov 14 11:06:35 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:06:35 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:06:35 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:06:35 user nova-compute[75255]:   </os>
Nov 14 11:06:35 user nova-compute[75255]:   <features>
Nov 14 11:06:35 user nova-compute[75255]:     <acpi/>
Nov 14 11:06:35 user nova-compute[75255]:     <apic/>
Nov 14 11:06:35 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:06:35 user nova-compute[75255]:   </features>
Nov 14 11:06:35 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:06:35 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:06:35 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:06:35 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:06:35 user nova-compute[75255]:   </clock>
Nov 14 11:06:35 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:06:35 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:06:35 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:06:35 user nova-compute[75255]:   </cpu>
Nov 14 11:06:35 user nova-compute[75255]:   <devices>
Nov 14 11:06:35 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:06:35 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:06:35 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk"/>
Nov 14 11:06:35 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:06:35 user nova-compute[75255]:     </disk>
Nov 14 11:06:35 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:06:35 user nova-compute[75255]:       <mac address="fa:16:3e:47:a1:19"/>
Nov 14 11:06:35 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:35 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:06:35 user nova-compute[75255]:       <target dev="tap8730dcdf-d2"/>
Nov 14 11:06:35 user nova-compute[75255]:     </interface>
Nov 14 11:06:35 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:06:35 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/console.log" append="off"/>
Nov 14 11:06:35 user nova-compute[75255]:     </serial>
Nov 14 11:06:35 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:06:35 user nova-compute[75255]:     <video>
Nov 14 11:06:35 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:35 user nova-compute[75255]:     </video>
Nov 14 11:06:35 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:06:35 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:06:35 user nova-compute[75255]:     </rng>
Nov 14 11:06:35 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:06:35 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:06:35 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:06:35 user nova-compute[75255]:     </memballoon>
Nov 14 11:06:35 user nova-compute[75255]:   </devices>
Nov 14 11:06:35 user nova-compute[75255]: </domain>
Nov 14 11:06:35 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG os_vif [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac70d005-d2cb-57f9-84aa-74991961abd8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.neutron [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updated VIF entry in instance network info cache for port 10813fe9-0bbf-4535-87ea-34769197f996. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.neutron [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updating instance_info_cache with network_info: [{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-79e7e0ff-b645-4b5a-bd9e-b6b7d723f598 req-c9f14cb2-da5f-4744-94f6-fad25e48db5c service nova] Releasing lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:06:35 user nova-compute[75255]: INFO nova.compute.claims [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Claim successful on node user
Nov 14 11:06:35 user sudo[84567]: pam_unix(sudo:session): session closed for user root
Nov 14 11:06:35 user nova-compute[75255]: INFO oslo.privsep.daemon [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Spawned new privsep daemon via rootwrap
Nov 14 11:06:35 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 11:06:35 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 11:06:35 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 11:06:35 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84576
Nov 14 11:06:35 user nova-compute[75255]: WARNING oslo_privsep.priv_context [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] privsep daemon already running
Nov 14 11:06:35 user nova-compute[75255]: WARNING oslo_privsep.priv_context [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] privsep daemon already running
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:06:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8730dcdf-d2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8730dcdf-d2, col_values=(('qos', UUID('92b1338c-688e-4c7c-9d67-e49127c2db2a')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8730dcdf-d2, col_values=(('external_ids', {'iface-id': '8730dcdf-d2cb-4be1-aa6a-299cb1b955bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:a1:19', 'vm-uuid': '26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: INFO os_vif [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2')
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7853a5a2-53, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7853a5a2-53, col_values=(('qos', UUID('ac405d98-0733-47b1-994b-8b252b3e7dc6')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7853a5a2-53, col_values=(('external_ids', {'iface-id': '7853a5a2-5301-4337-a5a4-6bcddf944f11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:c9:63', 'vm-uuid': '943d1e23-bb99-4499-83db-eca996c3fedf'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: INFO os_vif [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53')
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10813fe9-0b, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10813fe9-0b, col_values=(('qos', UUID('a014ac24-5795-4cf4-88db-7bb598393042')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10813fe9-0b, col_values=(('external_ids', {'iface-id': '10813fe9-0bbf-4535-87ea-34769197f996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:f5:ff', 'vm-uuid': '66031f17-4225-4c50-bd18-3df496586023'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:35 user nova-compute[75255]: INFO os_vif [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b')
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:06:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Creating image(s)
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "/opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No VIF found with MAC fa:16:3e:47:a1:19, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No VIF found with MAC fa:16:3e:f7:c9:63, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No VIF found with MAC fa:16:3e:da:f5:ff, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.policy [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501c5fe846ca4bfeacc413c97911f8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524a841af9524bd98f64657594598808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk 1073741824" returned: 0 in 0.046s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.network.neutron [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updated VIF entry in instance network info cache for port 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.network.neutron [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0c064387-a611-42eb-bf3e-0e956fcd57b2 req-8a37e5ec-cddb-48a1-be7c-e5fc459aa62d service nova] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Cannot resize image /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Ensure instance console log exists: /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Successfully created port: a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:06:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Successfully updated port: a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquired lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-changed-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Refreshing instance network info cache due to event network-changed-a7b74d75-61f6-40f3-bd68-04c50de0c3b3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] Acquiring lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:06:41 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance spawned successfully.
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:06:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance spawned successfully.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Took 13.32 seconds to spawn the instance on the hypervisor.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Took 14.62 seconds to spawn the instance on the hypervisor.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.compute.manager [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Took 14.20 seconds to build instance.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance spawned successfully.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01701e7d-0e41-42c1-8739-c5cdd7a0159d tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.353s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.compute.manager [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Took 15.72 seconds to build instance.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-edd8c8b0-c043-433d-b886-85c36dbef1ca tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "66031f17-4225-4c50-bd18-3df496586023" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.538s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Took 16.93 seconds to spawn the instance on the hypervisor.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:06:42 user nova-compute[75255]: INFO nova.compute.manager [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Took 18.43 seconds to build instance.
Nov 14 11:06:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-62e08e86-51f6-45de-9650-12cbd3eef5c0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.735s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.network.neutron [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updating instance_info_cache with network_info: [{"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Releasing lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Instance network_info: |[{"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] Acquired lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:42 user nova-compute[75255]: DEBUG nova.network.neutron [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Refreshing network info cache for port a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Start _get_guest_xml network_info=[{"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:06:43 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:43 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1544469479',display_name='tempest-AttachVolumeNegativeTest-server-1544469479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1544469479',id=4,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC5AfALzTEcMOMPPjP1RRWQSRQv6xwe4qIJZu4lq1OD/RdKjscUhWi11xtMLgh/IuqwEeuXVq2am6ZUU50GOc/dGAvfbXswxCM1uqDJhF5qA7yubJMa0fqK2xaP19YFgw==',key_name='tempest-keypair-1461427568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-8008q8r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=55b1ffe7-9be4-4ff1-9ed7-559cf6270eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:6b,bridge_name='br-int',has_traffic_filtering=True,id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b74d75-61') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.objects.instance [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'pci_devices' on Instance uuid 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:06:43 user nova-compute[75255]:   <uuid>55b1ffe7-9be4-4ff1-9ed7-559cf6270eea</uuid>
Nov 14 11:06:43 user nova-compute[75255]:   <name>instance-00000004</name>
Nov 14 11:06:43 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:06:43 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:06:43 user nova-compute[75255]:   <metadata>
Nov 14 11:06:43 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:06:43 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:06:43 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1544469479</nova:name>
Nov 14 11:06:43 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:06:43</nova:creationTime>
Nov 14 11:06:43 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:06:43 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:06:43 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:06:43 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:06:43 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:06:43 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:06:43 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:06:43 user nova-compute[75255]:       <nova:owner>
Nov 14 11:06:43 user nova-compute[75255]:         <nova:user uuid="501c5fe846ca4bfeacc413c97911f8f6">tempest-AttachVolumeNegativeTest-1930109654-project-member</nova:user>
Nov 14 11:06:43 user nova-compute[75255]:         <nova:project uuid="524a841af9524bd98f64657594598808">tempest-AttachVolumeNegativeTest-1930109654</nova:project>
Nov 14 11:06:43 user nova-compute[75255]:       </nova:owner>
Nov 14 11:06:43 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:06:43 user nova-compute[75255]:       <nova:ports>
Nov 14 11:06:43 user nova-compute[75255]:         <nova:port uuid="a7b74d75-61f6-40f3-bd68-04c50de0c3b3">
Nov 14 11:06:43 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 11:06:43 user nova-compute[75255]:         </nova:port>
Nov 14 11:06:43 user nova-compute[75255]:       </nova:ports>
Nov 14 11:06:43 user nova-compute[75255]:     </nova:instance>
Nov 14 11:06:43 user nova-compute[75255]:   </metadata>
Nov 14 11:06:43 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:06:43 user nova-compute[75255]:     <system>
Nov 14 11:06:43 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:06:43 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:06:43 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:06:43 user nova-compute[75255]:       <entry name="serial">55b1ffe7-9be4-4ff1-9ed7-559cf6270eea</entry>
Nov 14 11:06:43 user nova-compute[75255]:       <entry name="uuid">55b1ffe7-9be4-4ff1-9ed7-559cf6270eea</entry>
Nov 14 11:06:43 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:06:43 user nova-compute[75255]:     </system>
Nov 14 11:06:43 user nova-compute[75255]:   </sysinfo>
Nov 14 11:06:43 user nova-compute[75255]:   <os>
Nov 14 11:06:43 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:06:43 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:06:43 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:06:43 user nova-compute[75255]:   </os>
Nov 14 11:06:43 user nova-compute[75255]:   <features>
Nov 14 11:06:43 user nova-compute[75255]:     <acpi/>
Nov 14 11:06:43 user nova-compute[75255]:     <apic/>
Nov 14 11:06:43 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:06:43 user nova-compute[75255]:   </features>
Nov 14 11:06:43 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:06:43 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:06:43 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:06:43 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:06:43 user nova-compute[75255]:   </clock>
Nov 14 11:06:43 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:06:43 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:06:43 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:06:43 user nova-compute[75255]:   </cpu>
Nov 14 11:06:43 user nova-compute[75255]:   <devices>
Nov 14 11:06:43 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:06:43 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:06:43 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk"/>
Nov 14 11:06:43 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:06:43 user nova-compute[75255]:     </disk>
Nov 14 11:06:43 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:06:43 user nova-compute[75255]:       <mac address="fa:16:3e:87:f3:6b"/>
Nov 14 11:06:43 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:43 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:06:43 user nova-compute[75255]:       <target dev="tapa7b74d75-61"/>
Nov 14 11:06:43 user nova-compute[75255]:     </interface>
Nov 14 11:06:43 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:06:43 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/console.log" append="off"/>
Nov 14 11:06:43 user nova-compute[75255]:     </serial>
Nov 14 11:06:43 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:06:43 user nova-compute[75255]:     <video>
Nov 14 11:06:43 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:43 user nova-compute[75255]:     </video>
Nov 14 11:06:43 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:06:43 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:06:43 user nova-compute[75255]:     </rng>
Nov 14 11:06:43 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:06:43 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:06:43 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:06:43 user nova-compute[75255]:     </memballoon>
Nov 14 11:06:43 user nova-compute[75255]:   </devices>
Nov 14 11:06:43 user nova-compute[75255]: </domain>
Nov 14 11:06:43 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1544469479',display_name='tempest-AttachVolumeNegativeTest-server-1544469479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1544469479',id=4,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC5AfALzTEcMOMPPjP1RRWQSRQv6xwe4qIJZu4lq1OD/RdKjscUhWi11xtMLgh/IuqwEeuXVq2am6ZUU50GOc/dGAvfbXswxCM1uqDJhF5qA7yubJMa0fqK2xaP19YFgw==',key_name='tempest-keypair-1461427568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-8008q8r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=55b1ffe7-9be4-4ff1-9ed7-559cf6270eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:6b,bridge_name='br-int',has_traffic_filtering=True,id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b74d75-61') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG os_vif [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:6b,bridge_name='br-int',has_traffic_filtering=True,id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b74d75-61') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6eaf61c1-3771-5f50-a77b-b85c74aa713e', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7b74d75-61, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7b74d75-61, col_values=(('qos', UUID('4e1432fe-0806-4fe5-ae55-39542cb6f026')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7b74d75-61, col_values=(('external_ids', {'iface-id': 'a7b74d75-61f6-40f3-bd68-04c50de0c3b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f3:6b', 'vm-uuid': '55b1ffe7-9be4-4ff1-9ed7-559cf6270eea'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:43 user nova-compute[75255]: INFO os_vif [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:6b,bridge_name='br-int',has_traffic_filtering=True,id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b74d75-61')
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No VIF found with MAC fa:16:3e:87:f3:6b, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:06:43 user nova-compute[75255]: INFO nova.compute.claims [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Claim successful on node user
Nov 14 11:06:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updated VIF entry in instance network info cache for port a7b74d75-61f6-40f3-bd68-04c50de0c3b3. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.network.neutron [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updating instance_info_cache with network_info: [{"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3ee27444-d4c4-4d4a-a18f-9a3e8dd78743 req-e125bc1b-bcdf-4324-af08-e7973575fe51 service nova] Releasing lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:06:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.policy [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52279ec6cb8044ad9b7b81808b7631dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea68b5a52247427da8880074883a4ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:06:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Creating image(s)
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "/opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "/opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.242s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.295s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk 1073741824" returned: 0 in 0.057s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.255s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Cannot resize image /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Ensure instance console log exists: /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-665089fc-9681-4ba9-828c-82a28193fde2 req-671597dd-ce11-41be-a461-10b7246a1431 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-665089fc-9681-4ba9-828c-82a28193fde2 req-671597dd-ce11-41be-a461-10b7246a1431 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-665089fc-9681-4ba9-828c-82a28193fde2 req-671597dd-ce11-41be-a461-10b7246a1431 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-665089fc-9681-4ba9-828c-82a28193fde2 req-671597dd-ce11-41be-a461-10b7246a1431 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-665089fc-9681-4ba9-828c-82a28193fde2 req-671597dd-ce11-41be-a461-10b7246a1431 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:45 user nova-compute[75255]: WARNING nova.compute.manager [req-665089fc-9681-4ba9-828c-82a28193fde2 req-671597dd-ce11-41be-a461-10b7246a1431 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state active and task_state None.
Nov 14 11:06:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Successfully created port: 835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-a16aca30-cbdc-4366-ab03-586931ec7142 req-2798b3c0-f7c9-4f5e-a4f4-08a2abab9999 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a16aca30-cbdc-4366-ab03-586931ec7142 req-2798b3c0-f7c9-4f5e-a4f4-08a2abab9999 service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a16aca30-cbdc-4366-ab03-586931ec7142 req-2798b3c0-f7c9-4f5e-a4f4-08a2abab9999 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a16aca30-cbdc-4366-ab03-586931ec7142 req-2798b3c0-f7c9-4f5e-a4f4-08a2abab9999 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-a16aca30-cbdc-4366-ab03-586931ec7142 req-2798b3c0-f7c9-4f5e-a4f4-08a2abab9999 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:46 user nova-compute[75255]: WARNING nova.compute.manager [req-a16aca30-cbdc-4366-ab03-586931ec7142 req-2798b3c0-f7c9-4f5e-a4f4-08a2abab9999 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received unexpected event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with vm_state active and task_state None.
Nov 14 11:06:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:48 user nova-compute[75255]: WARNING nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state active and task_state None.
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:48 user nova-compute[75255]: WARNING nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state None.
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:48 user nova-compute[75255]: WARNING nova.compute.manager [req-c71fa75e-d143-488d-b645-d364ec89d3d4 req-d2d4ff29-5c04-41be-91fb-92f3b8fd2754 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state None.
Nov 14 11:06:48 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Instance spawned successfully.
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:48 user nova-compute[75255]: INFO nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Took 12.32 seconds to spawn the instance on the hypervisor.
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Successfully updated port: 835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquired lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:06:48 user nova-compute[75255]: INFO nova.compute.manager [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Took 13.46 seconds to build instance.
Nov 14 11:06:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-656dcdcf-8dce-4efc-91de-834f46eb9588 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.666s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-712dcce8-28e3-4b0c-80dc-7014bd627774 req-fcc93955-880f-4198-83da-027070c39e67 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-712dcce8-28e3-4b0c-80dc-7014bd627774 req-fcc93955-880f-4198-83da-027070c39e67 service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-712dcce8-28e3-4b0c-80dc-7014bd627774 req-fcc93955-880f-4198-83da-027070c39e67 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-712dcce8-28e3-4b0c-80dc-7014bd627774 req-fcc93955-880f-4198-83da-027070c39e67 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-712dcce8-28e3-4b0c-80dc-7014bd627774 req-fcc93955-880f-4198-83da-027070c39e67 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:48 user nova-compute[75255]: WARNING nova.compute.manager [req-712dcce8-28e3-4b0c-80dc-7014bd627774 req-fcc93955-880f-4198-83da-027070c39e67 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received unexpected event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with vm_state active and task_state None.
Nov 14 11:06:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.network.neutron [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updating instance_info_cache with network_info: [{"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Releasing lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Instance network_info: |[{"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Start _get_guest_xml network_info=[{"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:06:50 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:50 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1356594912',display_name='tempest-VolumesAdminNegativeTest-server-1356594912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1356594912',id=5,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdEweCIKninRK6dS7x3JfC4ui+pVgotMlL5HAeo5WX2If/zjnYxWKp59yRleNcazS5Wh+XJCEpNCJwDIFULT1y59Dq4MwDD7kpBNN8S22yCy+Gh1dpJOkR8HcDhyqmAeA==',key_name='tempest-keypair-1124603066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea68b5a52247427da8880074883a4ce6',ramdisk_id='',reservation_id='r-drq9yih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-222875096',owner_user_name='tempest-VolumesAdminNegativeTest-222875096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52279ec6cb8044ad9b7b81808b7631dd',uuid=2e186944-c41d-4f07-b852-ff17b2241241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converting VIF {"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b1:bc,bridge_name='br-int',has_traffic_filtering=True,id=835970ab-7fbc-40e7-aa3d-7301d32d936e,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835970ab-7f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.objects.instance [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e186944-c41d-4f07-b852-ff17b2241241 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-changed-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Refreshing instance network info cache due to event network-changed-835970ab-7fbc-40e7-aa3d-7301d32d936e. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] Acquiring lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] Acquired lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Refreshing network info cache for port 835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:06:50 user nova-compute[75255]:   <uuid>2e186944-c41d-4f07-b852-ff17b2241241</uuid>
Nov 14 11:06:50 user nova-compute[75255]:   <name>instance-00000005</name>
Nov 14 11:06:50 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:06:50 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:06:50 user nova-compute[75255]:   <metadata>
Nov 14 11:06:50 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:06:50 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:06:50 user nova-compute[75255]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1356594912</nova:name>
Nov 14 11:06:50 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:06:50</nova:creationTime>
Nov 14 11:06:50 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:06:50 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:06:50 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:06:50 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:06:50 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:06:50 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:06:50 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:06:50 user nova-compute[75255]:       <nova:owner>
Nov 14 11:06:50 user nova-compute[75255]:         <nova:user uuid="52279ec6cb8044ad9b7b81808b7631dd">tempest-VolumesAdminNegativeTest-222875096-project-member</nova:user>
Nov 14 11:06:50 user nova-compute[75255]:         <nova:project uuid="ea68b5a52247427da8880074883a4ce6">tempest-VolumesAdminNegativeTest-222875096</nova:project>
Nov 14 11:06:50 user nova-compute[75255]:       </nova:owner>
Nov 14 11:06:50 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:06:50 user nova-compute[75255]:       <nova:ports>
Nov 14 11:06:50 user nova-compute[75255]:         <nova:port uuid="835970ab-7fbc-40e7-aa3d-7301d32d936e">
Nov 14 11:06:50 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:06:50 user nova-compute[75255]:         </nova:port>
Nov 14 11:06:50 user nova-compute[75255]:       </nova:ports>
Nov 14 11:06:50 user nova-compute[75255]:     </nova:instance>
Nov 14 11:06:50 user nova-compute[75255]:   </metadata>
Nov 14 11:06:50 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:06:50 user nova-compute[75255]:     <system>
Nov 14 11:06:50 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:06:50 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:06:50 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:06:50 user nova-compute[75255]:       <entry name="serial">2e186944-c41d-4f07-b852-ff17b2241241</entry>
Nov 14 11:06:50 user nova-compute[75255]:       <entry name="uuid">2e186944-c41d-4f07-b852-ff17b2241241</entry>
Nov 14 11:06:50 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:06:50 user nova-compute[75255]:     </system>
Nov 14 11:06:50 user nova-compute[75255]:   </sysinfo>
Nov 14 11:06:50 user nova-compute[75255]:   <os>
Nov 14 11:06:50 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:06:50 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:06:50 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:06:50 user nova-compute[75255]:   </os>
Nov 14 11:06:50 user nova-compute[75255]:   <features>
Nov 14 11:06:50 user nova-compute[75255]:     <acpi/>
Nov 14 11:06:50 user nova-compute[75255]:     <apic/>
Nov 14 11:06:50 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:06:50 user nova-compute[75255]:   </features>
Nov 14 11:06:50 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:06:50 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:06:50 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:06:50 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:06:50 user nova-compute[75255]:   </clock>
Nov 14 11:06:50 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:06:50 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:06:50 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:06:50 user nova-compute[75255]:   </cpu>
Nov 14 11:06:50 user nova-compute[75255]:   <devices>
Nov 14 11:06:50 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:06:50 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:06:50 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk"/>
Nov 14 11:06:50 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:06:50 user nova-compute[75255]:     </disk>
Nov 14 11:06:50 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:06:50 user nova-compute[75255]:       <mac address="fa:16:3e:6c:b1:bc"/>
Nov 14 11:06:50 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:50 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:06:50 user nova-compute[75255]:       <target dev="tap835970ab-7f"/>
Nov 14 11:06:50 user nova-compute[75255]:     </interface>
Nov 14 11:06:50 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:06:50 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/console.log" append="off"/>
Nov 14 11:06:50 user nova-compute[75255]:     </serial>
Nov 14 11:06:50 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:06:50 user nova-compute[75255]:     <video>
Nov 14 11:06:50 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:50 user nova-compute[75255]:     </video>
Nov 14 11:06:50 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:06:50 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:06:50 user nova-compute[75255]:     </rng>
Nov 14 11:06:50 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:06:50 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:06:50 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:06:50 user nova-compute[75255]:     </memballoon>
Nov 14 11:06:50 user nova-compute[75255]:   </devices>
Nov 14 11:06:50 user nova-compute[75255]: </domain>
Nov 14 11:06:50 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1356594912',display_name='tempest-VolumesAdminNegativeTest-server-1356594912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1356594912',id=5,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdEweCIKninRK6dS7x3JfC4ui+pVgotMlL5HAeo5WX2If/zjnYxWKp59yRleNcazS5Wh+XJCEpNCJwDIFULT1y59Dq4MwDD7kpBNN8S22yCy+Gh1dpJOkR8HcDhyqmAeA==',key_name='tempest-keypair-1124603066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea68b5a52247427da8880074883a4ce6',ramdisk_id='',reservation_id='r-drq9yih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-222875096',owner_user_name='tempest-VolumesAdminNegativeTest-222875096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52279ec6cb8044ad9b7b81808b7631dd',uuid=2e186944-c41d-4f07-b852-ff17b2241241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converting VIF {"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b1:bc,bridge_name='br-int',has_traffic_filtering=True,id=835970ab-7fbc-40e7-aa3d-7301d32d936e,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835970ab-7f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG os_vif [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b1:bc,bridge_name='br-int',has_traffic_filtering=True,id=835970ab-7fbc-40e7-aa3d-7301d32d936e,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835970ab-7f') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10c32ce0-88e8-5069-8c68-23931e790f7f', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap835970ab-7f, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap835970ab-7f, col_values=(('qos', UUID('71504454-96a3-45dd-a063-91aefa2d75d0')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap835970ab-7f, col_values=(('external_ids', {'iface-id': '835970ab-7fbc-40e7-aa3d-7301d32d936e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:b1:bc', 'vm-uuid': '2e186944-c41d-4f07-b852-ff17b2241241'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: INFO os_vif [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b1:bc,bridge_name='br-int',has_traffic_filtering=True,id=835970ab-7fbc-40e7-aa3d-7301d32d936e,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835970ab-7f')
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] No VIF found with MAC fa:16:3e:6c:b1:bc, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:50 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:06:51 user nova-compute[75255]: INFO nova.compute.claims [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Claim successful on node user
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updated VIF entry in instance network info cache for port 835970ab-7fbc-40e7-aa3d-7301d32d936e. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updating instance_info_cache with network_info: [{"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] Releasing lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] No waiting events found dispatching network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:51 user nova-compute[75255]: WARNING nova.compute.manager [req-4e9ce163-812e-4734-bd5b-82a802ad11ac req-ec58f9d9-5e61-4772-8cba-df6b5f6622a8 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received unexpected event network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 for instance with vm_state active and task_state None.
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.network.neutron [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:06:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.policy [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80ae2b32e6784b6faeb59736a1cac40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4f81e6ced34a3fa8853b6d98ad6c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.compute.manager [req-c6995b70-8ad9-42c9-ae5e-50a8decaf939 req-eaf31968-faae-4f4d-b8cc-f7805ce646b2 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c6995b70-8ad9-42c9-ae5e-50a8decaf939 req-eaf31968-faae-4f4d-b8cc-f7805ce646b2 service nova] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c6995b70-8ad9-42c9-ae5e-50a8decaf939 req-eaf31968-faae-4f4d-b8cc-f7805ce646b2 service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c6995b70-8ad9-42c9-ae5e-50a8decaf939 req-eaf31968-faae-4f4d-b8cc-f7805ce646b2 service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.compute.manager [req-c6995b70-8ad9-42c9-ae5e-50a8decaf939 req-eaf31968-faae-4f4d-b8cc-f7805ce646b2 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] No waiting events found dispatching network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:06:52 user nova-compute[75255]: WARNING nova.compute.manager [req-c6995b70-8ad9-42c9-ae5e-50a8decaf939 req-eaf31968-faae-4f4d-b8cc-f7805ce646b2 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received unexpected event network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 for instance with vm_state active and task_state None.
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:06:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Creating image(s)
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "/opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "/opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.413s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.248s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk 1073741824" returned: 0 in 0.205s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.480s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG nova.network.neutron [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Successfully created port: 6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.336s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Cannot resize image /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Ensure instance console log exists: /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:06:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Successfully updated port: 6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquired lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-changed-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Refreshing instance network info cache due to event network-changed-6deed208-a0e2-42d2-9f6d-60ca090458bb. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] Acquiring lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:06:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Instance spawned successfully.
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:06:55 user nova-compute[75255]: INFO nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Took 10.86 seconds to spawn the instance on the hypervisor.
Nov 14 11:06:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:06:55 user nova-compute[75255]: INFO nova.compute.manager [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Took 12.00 seconds to build instance.
Nov 14 11:06:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-460d7053-c864-4904-b759-98034b6f2a29 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.368s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Updating instance_info_cache with network_info: [{"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Releasing lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Instance network_info: |[{"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] Acquired lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Refreshing network info cache for port 6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Start _get_guest_xml network_info=[{"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:06:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-303193',display_name='tempest-TestVolumeSwap-server-303193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-303193',id=6,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHuw08HSgbQdJbR2bf2HTFdjMAhff4Od98+9uEGRXt6y9b0MBNpM90xQuKmbH3eybqUN1QDmECd7zC0RQ3K9QIxSezb1GxTDJT2Tkdm2bJbgEsU4aqWrBe4Nu3sd3ELFQ==',key_name='tempest-keypair-789578368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d4f81e6ced34a3fa8853b6d98ad6c67',ramdisk_id='',reservation_id='r-z0ggo2i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1121882356',owner_user_name='tempest-TestVolumeSwap-1121882356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ae2b32e6784b6faeb59736a1cac40b',uuid=2ce264fc-cc38-421a-92ae-41dc6174745d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Converting VIF {"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e3:61,bridge_name='br-int',has_traffic_filtering=True,id=6deed208-a0e2-42d2-9f6d-60ca090458bb,network=Network(bdf36771-acc3-4124-b771-ab7404f929f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6deed208-a0') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.objects.instance [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:06:56 user nova-compute[75255]:   <uuid>2ce264fc-cc38-421a-92ae-41dc6174745d</uuid>
Nov 14 11:06:56 user nova-compute[75255]:   <name>instance-00000006</name>
Nov 14 11:06:56 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:06:56 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:06:56 user nova-compute[75255]:   <metadata>
Nov 14 11:06:56 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:06:56 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:06:56 user nova-compute[75255]:       <nova:name>tempest-TestVolumeSwap-server-303193</nova:name>
Nov 14 11:06:56 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:06:56</nova:creationTime>
Nov 14 11:06:56 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:06:56 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:06:56 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:06:56 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:06:56 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:06:56 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:06:56 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:06:56 user nova-compute[75255]:       <nova:owner>
Nov 14 11:06:56 user nova-compute[75255]:         <nova:user uuid="80ae2b32e6784b6faeb59736a1cac40b">tempest-TestVolumeSwap-1121882356-project-member</nova:user>
Nov 14 11:06:56 user nova-compute[75255]:         <nova:project uuid="0d4f81e6ced34a3fa8853b6d98ad6c67">tempest-TestVolumeSwap-1121882356</nova:project>
Nov 14 11:06:56 user nova-compute[75255]:       </nova:owner>
Nov 14 11:06:56 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:06:56 user nova-compute[75255]:       <nova:ports>
Nov 14 11:06:56 user nova-compute[75255]:         <nova:port uuid="6deed208-a0e2-42d2-9f6d-60ca090458bb">
Nov 14 11:06:56 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:06:56 user nova-compute[75255]:         </nova:port>
Nov 14 11:06:56 user nova-compute[75255]:       </nova:ports>
Nov 14 11:06:56 user nova-compute[75255]:     </nova:instance>
Nov 14 11:06:56 user nova-compute[75255]:   </metadata>
Nov 14 11:06:56 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:06:56 user nova-compute[75255]:     <system>
Nov 14 11:06:56 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:06:56 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:06:56 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:06:56 user nova-compute[75255]:       <entry name="serial">2ce264fc-cc38-421a-92ae-41dc6174745d</entry>
Nov 14 11:06:56 user nova-compute[75255]:       <entry name="uuid">2ce264fc-cc38-421a-92ae-41dc6174745d</entry>
Nov 14 11:06:56 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:06:56 user nova-compute[75255]:     </system>
Nov 14 11:06:56 user nova-compute[75255]:   </sysinfo>
Nov 14 11:06:56 user nova-compute[75255]:   <os>
Nov 14 11:06:56 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:06:56 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:06:56 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:06:56 user nova-compute[75255]:   </os>
Nov 14 11:06:56 user nova-compute[75255]:   <features>
Nov 14 11:06:56 user nova-compute[75255]:     <acpi/>
Nov 14 11:06:56 user nova-compute[75255]:     <apic/>
Nov 14 11:06:56 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:06:56 user nova-compute[75255]:   </features>
Nov 14 11:06:56 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:06:56 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:06:56 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:06:56 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:06:56 user nova-compute[75255]:   </clock>
Nov 14 11:06:56 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:06:56 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:06:56 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:06:56 user nova-compute[75255]:   </cpu>
Nov 14 11:06:56 user nova-compute[75255]:   <devices>
Nov 14 11:06:56 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:06:56 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:06:56 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk"/>
Nov 14 11:06:56 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:06:56 user nova-compute[75255]:     </disk>
Nov 14 11:06:56 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:06:56 user nova-compute[75255]:       <mac address="fa:16:3e:2f:e3:61"/>
Nov 14 11:06:56 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:56 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:06:56 user nova-compute[75255]:       <target dev="tap6deed208-a0"/>
Nov 14 11:06:56 user nova-compute[75255]:     </interface>
Nov 14 11:06:56 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:06:56 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/console.log" append="off"/>
Nov 14 11:06:56 user nova-compute[75255]:     </serial>
Nov 14 11:06:56 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:06:56 user nova-compute[75255]:     <video>
Nov 14 11:06:56 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:06:56 user nova-compute[75255]:     </video>
Nov 14 11:06:56 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:06:56 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:06:56 user nova-compute[75255]:     </rng>
Nov 14 11:06:56 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:06:56 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:06:56 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:06:56 user nova-compute[75255]:     </memballoon>
Nov 14 11:06:56 user nova-compute[75255]:   </devices>
Nov 14 11:06:56 user nova-compute[75255]: </domain>
Nov 14 11:06:56 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-303193',display_name='tempest-TestVolumeSwap-server-303193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-303193',id=6,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHuw08HSgbQdJbR2bf2HTFdjMAhff4Od98+9uEGRXt6y9b0MBNpM90xQuKmbH3eybqUN1QDmECd7zC0RQ3K9QIxSezb1GxTDJT2Tkdm2bJbgEsU4aqWrBe4Nu3sd3ELFQ==',key_name='tempest-keypair-789578368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d4f81e6ced34a3fa8853b6d98ad6c67',ramdisk_id='',reservation_id='r-z0ggo2i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1121882356',owner_user_name='tempest-TestVolumeSwap-1121882356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ae2b32e6784b6faeb59736a1cac40b',uuid=2ce264fc-cc38-421a-92ae-41dc6174745d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Converting VIF {"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e3:61,bridge_name='br-int',has_traffic_filtering=True,id=6deed208-a0e2-42d2-9f6d-60ca090458bb,network=Network(bdf36771-acc3-4124-b771-ab7404f929f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6deed208-a0') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG os_vif [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e3:61,bridge_name='br-int',has_traffic_filtering=True,id=6deed208-a0e2-42d2-9f6d-60ca090458bb,network=Network(bdf36771-acc3-4124-b771-ab7404f929f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6deed208-a0') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2587a2e-1d73-532a-b003-bb7be083679e', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6deed208-a0, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6deed208-a0, col_values=(('qos', UUID('336aa7ed-ea38-466e-8f02-6ee2c587b9b7')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6deed208-a0, col_values=(('external_ids', {'iface-id': '6deed208-a0e2-42d2-9f6d-60ca090458bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e3:61', 'vm-uuid': '2ce264fc-cc38-421a-92ae-41dc6174745d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:56 user nova-compute[75255]: INFO os_vif [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e3:61,bridge_name='br-int',has_traffic_filtering=True,id=6deed208-a0e2-42d2-9f6d-60ca090458bb,network=Network(bdf36771-acc3-4124-b771-ab7404f929f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6deed208-a0')
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:06:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] No VIF found with MAC fa:16:3e:2f:e3:61, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:06:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Updated VIF entry in instance network info cache for port 6deed208-a0e2-42d2-9f6d-60ca090458bb. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:06:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Updating instance_info_cache with network_info: [{"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:06:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-830b58ab-3402-4fad-9aa7-0dade9e0b42f req-3d757362-66a7-49aa-97d5-9ec58258fcb2 service nova] Releasing lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:06:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:06:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:07:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:00 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:07:00 user nova-compute[75255]: INFO nova.compute.claims [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Claim successful on node user
Nov 14 11:07:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:07:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Instance spawned successfully.
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:07:01 user nova-compute[75255]: INFO nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Took 9.29 seconds to spawn the instance on the hypervisor.
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.policy [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63f0fece81604357baee475eec22f8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d858f2f138546eaa36f5fd2905ee8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:07:01 user nova-compute[75255]: INFO nova.compute.manager [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Took 10.87 seconds to build instance.
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:07:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Creating image(s)
Nov 14 11:07:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "/opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "/opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "/opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "1a6733ef9ffd7a930fb267e280cb9d14d851d0d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "1a6733ef9ffd7a930fb267e280cb9d14d851d0d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfb639-5d24-464b-b349-74698ab021a7 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.099s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.part --force-share --output=json" returned: 0 in 0.256s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:02 user nova-compute[75255]: DEBUG nova.virt.images [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] 6f014766-2a26-4e7f-ba33-b47a47609633 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:07:02 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:07:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.part /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.part /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.converted" returned: 0 in 0.287s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9.converted --force-share --output=json" returned: 0 in 0.250s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "1a6733ef9ffd7a930fb267e280cb9d14d851d0d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.300s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "1a6733ef9ffd7a930fb267e280cb9d14d851d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "1a6733ef9ffd7a930fb267e280cb9d14d851d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9 --force-share --output=json" returned: 0 in 0.271s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9,backing_fmt=raw /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9,backing_fmt=raw /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk 1073741824" returned: 0 in 0.088s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "1a6733ef9ffd7a930fb267e280cb9d14d851d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:03 user nova-compute[75255]: DEBUG nova.network.neutron [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Successfully created port: 062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9 --force-share --output=json" returned: 0 in 0.264s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Cannot resize image /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Ensure instance console log exists: /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Successfully updated port: 062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquired lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-changed-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Refreshing instance network info cache due to event network-changed-062e8b6c-1f14-4ae5-af6d-f7479c26ad46. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] Acquiring lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Updating instance_info_cache with network_info: [{"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Releasing lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Instance network_info: |[{"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] Acquired lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Refreshing network info cache for port 062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Start _get_guest_xml network_info=[{"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:06:48Z,direct_url=<?>,disk_format='qcow2',id=6f014766-2a26-4e7f-ba33-b47a47609633,min_disk=0,min_ram=0,name='',owner='d5bbc6ec26354add98d1dd3a8d08aa64',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:06:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'scsi', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '6f014766-2a26-4e7f-ba33-b47a47609633'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:07:05 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:05 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:06:48Z,direct_url=<?>,disk_format='qcow2',id=6f014766-2a26-4e7f-ba33-b47a47609633,min_disk=0,min_ram=0,name='',owner='d5bbc6ec26354add98d1dd3a8d08aa64',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:06:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-486691638',display_name='tempest-AttachSCSIVolumeTestJSON-server-486691638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-486691638',id=7,image_ref='6f014766-2a26-4e7f-ba33-b47a47609633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANexeSEpWU31kpXnFl/up9wLSyasQylrq+E9etq3qHdlyqqIuQr6Sdwe6uFrayitJFL0Odf8rpH74YauEGWNwK+XY2JcGmivNDFfs2pQluuozX+1VHeuzeDXnchPdC2ew==',key_name='tempest-keypair-1081141500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d858f2f138546eaa36f5fd2905ee8c0',ramdisk_id='',reservation_id='r-ywl60khx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6f014766-2a26-4e7f-ba33-b47a47609633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-823122553',owner_user_name='tempest-AttachSCSIVolumeTestJSON-823122553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63f0fece81604357baee475eec22f8a0',uuid=722f579b-576b-4154-b380-7fc78dc7b9b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Converting VIF {"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=062e8b6c-1f14-4ae5-af6d-f7479c26ad46,network=Network(5974bfeb-8552-4d5c-b56e-e1304a342978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e8b6c-1f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.objects.instance [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lazy-loading 'pci_devices' on Instance uuid 722f579b-576b-4154-b380-7fc78dc7b9b9 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:07:05 user nova-compute[75255]:   <uuid>722f579b-576b-4154-b380-7fc78dc7b9b9</uuid>
Nov 14 11:07:05 user nova-compute[75255]:   <name>instance-00000007</name>
Nov 14 11:07:05 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:07:05 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:07:05 user nova-compute[75255]:   <metadata>
Nov 14 11:07:05 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:07:05 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:07:05 user nova-compute[75255]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-486691638</nova:name>
Nov 14 11:07:05 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:07:05</nova:creationTime>
Nov 14 11:07:05 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:07:05 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:07:05 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:07:05 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:07:05 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:07:05 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:07:05 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:07:05 user nova-compute[75255]:       <nova:owner>
Nov 14 11:07:05 user nova-compute[75255]:         <nova:user uuid="63f0fece81604357baee475eec22f8a0">tempest-AttachSCSIVolumeTestJSON-823122553-project-member</nova:user>
Nov 14 11:07:05 user nova-compute[75255]:         <nova:project uuid="1d858f2f138546eaa36f5fd2905ee8c0">tempest-AttachSCSIVolumeTestJSON-823122553</nova:project>
Nov 14 11:07:05 user nova-compute[75255]:       </nova:owner>
Nov 14 11:07:05 user nova-compute[75255]:       <nova:root type="image" uuid="6f014766-2a26-4e7f-ba33-b47a47609633"/>
Nov 14 11:07:05 user nova-compute[75255]:       <nova:ports>
Nov 14 11:07:05 user nova-compute[75255]:         <nova:port uuid="062e8b6c-1f14-4ae5-af6d-f7479c26ad46">
Nov 14 11:07:05 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 11:07:05 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:05 user nova-compute[75255]:       </nova:ports>
Nov 14 11:07:05 user nova-compute[75255]:     </nova:instance>
Nov 14 11:07:05 user nova-compute[75255]:   </metadata>
Nov 14 11:07:05 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:07:05 user nova-compute[75255]:     <system>
Nov 14 11:07:05 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:07:05 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:07:05 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:07:05 user nova-compute[75255]:       <entry name="serial">722f579b-576b-4154-b380-7fc78dc7b9b9</entry>
Nov 14 11:07:05 user nova-compute[75255]:       <entry name="uuid">722f579b-576b-4154-b380-7fc78dc7b9b9</entry>
Nov 14 11:07:05 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:07:05 user nova-compute[75255]:     </system>
Nov 14 11:07:05 user nova-compute[75255]:   </sysinfo>
Nov 14 11:07:05 user nova-compute[75255]:   <os>
Nov 14 11:07:05 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:07:05 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:07:05 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:07:05 user nova-compute[75255]:   </os>
Nov 14 11:07:05 user nova-compute[75255]:   <features>
Nov 14 11:07:05 user nova-compute[75255]:     <acpi/>
Nov 14 11:07:05 user nova-compute[75255]:     <apic/>
Nov 14 11:07:05 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:07:05 user nova-compute[75255]:   </features>
Nov 14 11:07:05 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:07:05 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:07:05 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:07:05 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:07:05 user nova-compute[75255]:   </clock>
Nov 14 11:07:05 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:07:05 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:07:05 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:07:05 user nova-compute[75255]:   </cpu>
Nov 14 11:07:05 user nova-compute[75255]:   <devices>
Nov 14 11:07:05 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:07:05 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:07:05 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk"/>
Nov 14 11:07:05 user nova-compute[75255]:       <target dev="sda" bus="scsi"/>
Nov 14 11:07:05 user nova-compute[75255]:       <address type="drive" controller="0" unit="0"/>
Nov 14 11:07:05 user nova-compute[75255]:     </disk>
Nov 14 11:07:05 user nova-compute[75255]:     <disk type="file" device="cdrom">
Nov 14 11:07:05 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 11:07:05 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk.config"/>
Nov 14 11:07:05 user nova-compute[75255]:       <target dev="sdb" bus="scsi"/>
Nov 14 11:07:05 user nova-compute[75255]:       <address type="drive" controller="0" unit="1"/>
Nov 14 11:07:05 user nova-compute[75255]:     </disk>
Nov 14 11:07:05 user nova-compute[75255]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 11:07:05 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:05 user nova-compute[75255]:       <mac address="fa:16:3e:45:87:1d"/>
Nov 14 11:07:05 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:05 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:05 user nova-compute[75255]:       <target dev="tap062e8b6c-1f"/>
Nov 14 11:07:05 user nova-compute[75255]:     </interface>
Nov 14 11:07:05 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:07:05 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/console.log" append="off"/>
Nov 14 11:07:05 user nova-compute[75255]:     </serial>
Nov 14 11:07:05 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:07:05 user nova-compute[75255]:     <video>
Nov 14 11:07:05 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:05 user nova-compute[75255]:     </video>
Nov 14 11:07:05 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:07:05 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:07:05 user nova-compute[75255]:     </rng>
Nov 14 11:07:05 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:07:05 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:07:05 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:07:05 user nova-compute[75255]:     </memballoon>
Nov 14 11:07:05 user nova-compute[75255]:   </devices>
Nov 14 11:07:05 user nova-compute[75255]: </domain>
Nov 14 11:07:05 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-486691638',display_name='tempest-AttachSCSIVolumeTestJSON-server-486691638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-486691638',id=7,image_ref='6f014766-2a26-4e7f-ba33-b47a47609633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANexeSEpWU31kpXnFl/up9wLSyasQylrq+E9etq3qHdlyqqIuQr6Sdwe6uFrayitJFL0Odf8rpH74YauEGWNwK+XY2JcGmivNDFfs2pQluuozX+1VHeuzeDXnchPdC2ew==',key_name='tempest-keypair-1081141500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d858f2f138546eaa36f5fd2905ee8c0',ramdisk_id='',reservation_id='r-ywl60khx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6f014766-2a26-4e7f-ba33-b47a47609633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-823122553',owner_user_name='tempest-AttachSCSIVolumeTestJSON-823122553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63f0fece81604357baee475eec22f8a0',uuid=722f579b-576b-4154-b380-7fc78dc7b9b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Converting VIF {"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=062e8b6c-1f14-4ae5-af6d-f7479c26ad46,network=Network(5974bfeb-8552-4d5c-b56e-e1304a342978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e8b6c-1f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG os_vif [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=062e8b6c-1f14-4ae5-af6d-f7479c26ad46,network=Network(5974bfeb-8552-4d5c-b56e-e1304a342978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e8b6c-1f') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2eb2d5e-6746-5791-acd8-be2a9dc9e871', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap062e8b6c-1f, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap062e8b6c-1f, col_values=(('qos', UUID('6f4384bc-7d0e-4c95-be5b-06c2ca03a95d')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap062e8b6c-1f, col_values=(('external_ids', {'iface-id': '062e8b6c-1f14-4ae5-af6d-f7479c26ad46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:87:1d', 'vm-uuid': '722f579b-576b-4154-b380-7fc78dc7b9b9'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:05 user nova-compute[75255]: INFO os_vif [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=062e8b6c-1f14-4ae5-af6d-f7479c26ad46,network=Network(5974bfeb-8552-4d5c-b56e-e1304a342978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e8b6c-1f')
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] No BDM found with device name sda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] No VIF found with MAC fa:16:3e:45:87:1d, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:07:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Using config drive
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Updated VIF entry in instance network info cache for port 062e8b6c-1f14-4ae5-af6d-f7479c26ad46. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Updating instance_info_cache with network_info: [{"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8cab4edd-fe57-4875-b7bd-3e4e7bc38280 req-cca6c6a6-a8aa-4efd-9009-b8af99771d9e service nova] Releasing lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:07:06 user nova-compute[75255]: INFO nova.compute.claims [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Claim successful on node user
Nov 14 11:07:06 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Creating config drive at /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk.config
Nov 14 11:07:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphkduibyn {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphkduibyn" returned: 0 in 0.118s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:07:06 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:07:07 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:07:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG nova.policy [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '131d5867bb7f4f3bad0889df1d1f52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d728ce7e654140995d4ab0e3c81b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:07:07 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Creating image(s)
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.222s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.215s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk 1073741824" returned: 0 in 0.056s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Cannot resize image /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Ensure instance console log exists: /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Successfully created port: 7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-05f620cc-3c00-420e-8412-fc491a549c82 req-59a999db-1bc4-4f07-b97a-ec40ac71e802 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-05f620cc-3c00-420e-8412-fc491a549c82 req-59a999db-1bc4-4f07-b97a-ec40ac71e802 service nova] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-05f620cc-3c00-420e-8412-fc491a549c82 req-59a999db-1bc4-4f07-b97a-ec40ac71e802 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-05f620cc-3c00-420e-8412-fc491a549c82 req-59a999db-1bc4-4f07-b97a-ec40ac71e802 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-05f620cc-3c00-420e-8412-fc491a549c82 req-59a999db-1bc4-4f07-b97a-ec40ac71e802 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] No waiting events found dispatching network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:10 user nova-compute[75255]: WARNING nova.compute.manager [req-05f620cc-3c00-420e-8412-fc491a549c82 req-59a999db-1bc4-4f07-b97a-ec40ac71e802 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received unexpected event network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 for instance with vm_state building and task_state spawning.
Nov 14 11:07:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:07:11 user nova-compute[75255]: INFO nova.compute.claims [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Claim successful on node user
Nov 14 11:07:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Successfully updated port: 7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquired lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-changed-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Refreshing instance network info cache due to event network-changed-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] Acquiring lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-f6cf20a7-0560-4584-b4d3-1dbcdc67be58 req-ac87963f-44da-4bac-8d97-a8e0e4026be7 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f6cf20a7-0560-4584-b4d3-1dbcdc67be58 req-ac87963f-44da-4bac-8d97-a8e0e4026be7 service nova] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f6cf20a7-0560-4584-b4d3-1dbcdc67be58 req-ac87963f-44da-4bac-8d97-a8e0e4026be7 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f6cf20a7-0560-4584-b4d3-1dbcdc67be58 req-ac87963f-44da-4bac-8d97-a8e0e4026be7 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-f6cf20a7-0560-4584-b4d3-1dbcdc67be58 req-ac87963f-44da-4bac-8d97-a8e0e4026be7 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] No waiting events found dispatching network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:12 user nova-compute[75255]: WARNING nova.compute.manager [req-f6cf20a7-0560-4584-b4d3-1dbcdc67be58 req-ac87963f-44da-4bac-8d97-a8e0e4026be7 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received unexpected event network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 for instance with vm_state building and task_state spawning.
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:07:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Instance spawned successfully.
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.892s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:07:12 user nova-compute[75255]: INFO nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Took 10.50 seconds to spawn the instance on the hypervisor.
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:07:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.policy [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce374c4f13b942f6975f9a0f48297e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd85bbe9945438bbeb05dddc2699c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:07:12 user nova-compute[75255]: INFO nova.compute.manager [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Took 11.84 seconds to build instance.
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-23b8d11e-9426-48fd-9457-4c1727f5ed6b tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.973s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Releasing lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Instance network_info: |[{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] Acquired lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Refreshing network info cache for port 7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Start _get_guest_xml network_info=[{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:07:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Creating image(s)
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "/opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "/opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "/opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.049s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:13 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:13 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converting VIF {"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:be:4a,bridge_name='br-int',has_traffic_filtering=True,id=7e5074e8-0f3b-4d4e-886d-b667c9ec37c9,network=Network(21bb0e83-7000-4a7e-b982-38a074591b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5074e8-0f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'pci_devices' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:07:13 user nova-compute[75255]:   <uuid>d7f63547-b356-471b-825d-6a0b4670221d</uuid>
Nov 14 11:07:13 user nova-compute[75255]:   <name>instance-00000008</name>
Nov 14 11:07:13 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:07:13 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:07:13 user nova-compute[75255]:   <metadata>
Nov 14 11:07:13 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:07:13 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:07:13 user nova-compute[75255]:       <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:07:13 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:07:13</nova:creationTime>
Nov 14 11:07:13 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:07:13 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:07:13 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:07:13 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:07:13 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:07:13 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:07:13 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:07:13 user nova-compute[75255]:       <nova:owner>
Nov 14 11:07:13 user nova-compute[75255]:         <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:07:13 user nova-compute[75255]:         <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:07:13 user nova-compute[75255]:       </nova:owner>
Nov 14 11:07:13 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:07:13 user nova-compute[75255]:       <nova:ports>
Nov 14 11:07:13 user nova-compute[75255]:         <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:07:13 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:07:13 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:13 user nova-compute[75255]:       </nova:ports>
Nov 14 11:07:13 user nova-compute[75255]:     </nova:instance>
Nov 14 11:07:13 user nova-compute[75255]:   </metadata>
Nov 14 11:07:13 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:07:13 user nova-compute[75255]:     <system>
Nov 14 11:07:13 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:07:13 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:07:13 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:07:13 user nova-compute[75255]:       <entry name="serial">d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:07:13 user nova-compute[75255]:       <entry name="uuid">d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:07:13 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:07:13 user nova-compute[75255]:     </system>
Nov 14 11:07:13 user nova-compute[75255]:   </sysinfo>
Nov 14 11:07:13 user nova-compute[75255]:   <os>
Nov 14 11:07:13 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:07:13 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:07:13 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:07:13 user nova-compute[75255]:   </os>
Nov 14 11:07:13 user nova-compute[75255]:   <features>
Nov 14 11:07:13 user nova-compute[75255]:     <acpi/>
Nov 14 11:07:13 user nova-compute[75255]:     <apic/>
Nov 14 11:07:13 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:07:13 user nova-compute[75255]:   </features>
Nov 14 11:07:13 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:07:13 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:07:13 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:07:13 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:07:13 user nova-compute[75255]:   </clock>
Nov 14 11:07:13 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:07:13 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:07:13 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:07:13 user nova-compute[75255]:   </cpu>
Nov 14 11:07:13 user nova-compute[75255]:   <devices>
Nov 14 11:07:13 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:07:13 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:07:13 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk"/>
Nov 14 11:07:13 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:07:13 user nova-compute[75255]:     </disk>
Nov 14 11:07:13 user nova-compute[75255]:     <disk type="file" device="cdrom">
Nov 14 11:07:13 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 11:07:13 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config"/>
Nov 14 11:07:13 user nova-compute[75255]:       <target dev="hda" bus="ide"/>
Nov 14 11:07:13 user nova-compute[75255]:     </disk>
Nov 14 11:07:13 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:13 user nova-compute[75255]:       <mac address="fa:16:3e:ab:be:4a"/>
Nov 14 11:07:13 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:13 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:13 user nova-compute[75255]:       <target dev="tap7e5074e8-0f"/>
Nov 14 11:07:13 user nova-compute[75255]:     </interface>
Nov 14 11:07:13 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:07:13 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log" append="off"/>
Nov 14 11:07:13 user nova-compute[75255]:     </serial>
Nov 14 11:07:13 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:07:13 user nova-compute[75255]:     <video>
Nov 14 11:07:13 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:13 user nova-compute[75255]:     </video>
Nov 14 11:07:13 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:07:13 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:07:13 user nova-compute[75255]:     </rng>
Nov 14 11:07:13 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:07:13 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:07:13 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:07:13 user nova-compute[75255]:     </memballoon>
Nov 14 11:07:13 user nova-compute[75255]:   </devices>
Nov 14 11:07:13 user nova-compute[75255]: </domain>
Nov 14 11:07:13 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converting VIF {"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:be:4a,bridge_name='br-int',has_traffic_filtering=True,id=7e5074e8-0f3b-4d4e-886d-b667c9ec37c9,network=Network(21bb0e83-7000-4a7e-b982-38a074591b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5074e8-0f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG os_vif [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:be:4a,bridge_name='br-int',has_traffic_filtering=True,id=7e5074e8-0f3b-4d4e-886d-b667c9ec37c9,network=Network(21bb0e83-7000-4a7e-b982-38a074591b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5074e8-0f') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdefb942-b93e-5dc5-b5b7-b65a410876ee', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.203s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e5074e8-0f, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e5074e8-0f, col_values=(('qos', UUID('54bed34f-726e-46f0-9e37-f7ca71250012')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e5074e8-0f, col_values=(('external_ids', {'iface-id': '7e5074e8-0f3b-4d4e-886d-b667c9ec37c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:be:4a', 'vm-uuid': 'd7f63547-b356-471b-825d-6a0b4670221d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:13 user nova-compute[75255]: INFO os_vif [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:be:4a,bridge_name='br-int',has_traffic_filtering=True,id=7e5074e8-0f3b-4d4e-886d-b667c9ec37c9,network=Network(21bb0e83-7000-4a7e-b982-38a074591b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5074e8-0f')
Nov 14 11:07:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No BDM found with device name hda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No VIF found with MAC fa:16:3e:ab:be:4a, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:07:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Using config drive
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.228s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk 1073741824" returned: 0 in 0.099s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Creating config drive at /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz1b_mes0 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.245s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz1b_mes0" returned: 0 in 0.078s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Cannot resize image /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Ensure instance console log exists: /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Successfully created port: 438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updated VIF entry in instance network info cache for port 7e5074e8-0f3b-4d4e-886d-b667c9ec37c9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-75eb9a96-32fc-47f4-8735-2564607a07a0 req-72314648-1a77-4154-b60e-639d82cec2d2 service nova] Releasing lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Successfully updated port: 438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquired lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-changed-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Refreshing instance network info cache due to event network-changed-438aabcf-8c82-4604-a29b-fa5d012b879d. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] Acquiring lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Updating instance_info_cache with network_info: [{"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Releasing lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Instance network_info: |[{"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] Acquired lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.network.neutron [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Refreshing network info cache for port 438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Start _get_guest_xml network_info=[{"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:07:15 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:15 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-994548043',display_name='tempest-VolumesAssistedSnapshotsTest-server-994548043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-994548043',id=9,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfiieOnhk+TkdK6HQDW3uzXl4qlxoCDsefMwv3ctlPF8IZqGpZxjgWb4wGY3jT42SNEnLW977OHmPQ2gRdrlceQFAJmidYeZ9S73SsHx1RJ6nMCpPtAfQ/UXVLjOFERYA==',key_name='tempest-keypair-1355363180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cd85bbe9945438bbeb05dddc2699c90',ramdisk_id='',reservation_id='r-xlefamvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1968772865',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1968772865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce374c4f13b942f6975f9a0f48297e8e',uuid=41aa15c1-08df-4bc5-907c-36790452a8af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Converting VIF {"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:23:c0,bridge_name='br-int',has_traffic_filtering=True,id=438aabcf-8c82-4604-a29b-fa5d012b879d,network=Network(bc8a8b7f-8112-406f-a729-95e316aed630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438aabcf-8c') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lazy-loading 'pci_devices' on Instance uuid 41aa15c1-08df-4bc5-907c-36790452a8af {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:07:16 user nova-compute[75255]:   <uuid>41aa15c1-08df-4bc5-907c-36790452a8af</uuid>
Nov 14 11:07:16 user nova-compute[75255]:   <name>instance-00000009</name>
Nov 14 11:07:16 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:07:16 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:07:16 user nova-compute[75255]:   <metadata>
Nov 14 11:07:16 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:07:16 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:07:16 user nova-compute[75255]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-994548043</nova:name>
Nov 14 11:07:16 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:07:15</nova:creationTime>
Nov 14 11:07:16 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:07:16 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:07:16 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:07:16 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:07:16 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:07:16 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:07:16 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:07:16 user nova-compute[75255]:       <nova:owner>
Nov 14 11:07:16 user nova-compute[75255]:         <nova:user uuid="ce374c4f13b942f6975f9a0f48297e8e">tempest-VolumesAssistedSnapshotsTest-1968772865-project-member</nova:user>
Nov 14 11:07:16 user nova-compute[75255]:         <nova:project uuid="0cd85bbe9945438bbeb05dddc2699c90">tempest-VolumesAssistedSnapshotsTest-1968772865</nova:project>
Nov 14 11:07:16 user nova-compute[75255]:       </nova:owner>
Nov 14 11:07:16 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:07:16 user nova-compute[75255]:       <nova:ports>
Nov 14 11:07:16 user nova-compute[75255]:         <nova:port uuid="438aabcf-8c82-4604-a29b-fa5d012b879d">
Nov 14 11:07:16 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 11:07:16 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:16 user nova-compute[75255]:       </nova:ports>
Nov 14 11:07:16 user nova-compute[75255]:     </nova:instance>
Nov 14 11:07:16 user nova-compute[75255]:   </metadata>
Nov 14 11:07:16 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:07:16 user nova-compute[75255]:     <system>
Nov 14 11:07:16 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:07:16 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:07:16 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:07:16 user nova-compute[75255]:       <entry name="serial">41aa15c1-08df-4bc5-907c-36790452a8af</entry>
Nov 14 11:07:16 user nova-compute[75255]:       <entry name="uuid">41aa15c1-08df-4bc5-907c-36790452a8af</entry>
Nov 14 11:07:16 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:07:16 user nova-compute[75255]:     </system>
Nov 14 11:07:16 user nova-compute[75255]:   </sysinfo>
Nov 14 11:07:16 user nova-compute[75255]:   <os>
Nov 14 11:07:16 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:07:16 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:07:16 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:07:16 user nova-compute[75255]:   </os>
Nov 14 11:07:16 user nova-compute[75255]:   <features>
Nov 14 11:07:16 user nova-compute[75255]:     <acpi/>
Nov 14 11:07:16 user nova-compute[75255]:     <apic/>
Nov 14 11:07:16 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:07:16 user nova-compute[75255]:   </features>
Nov 14 11:07:16 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:07:16 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:07:16 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:07:16 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:07:16 user nova-compute[75255]:   </clock>
Nov 14 11:07:16 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:07:16 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:07:16 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:07:16 user nova-compute[75255]:   </cpu>
Nov 14 11:07:16 user nova-compute[75255]:   <devices>
Nov 14 11:07:16 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:07:16 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:07:16 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk"/>
Nov 14 11:07:16 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:07:16 user nova-compute[75255]:     </disk>
Nov 14 11:07:16 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:16 user nova-compute[75255]:       <mac address="fa:16:3e:24:23:c0"/>
Nov 14 11:07:16 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:16 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:16 user nova-compute[75255]:       <target dev="tap438aabcf-8c"/>
Nov 14 11:07:16 user nova-compute[75255]:     </interface>
Nov 14 11:07:16 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:07:16 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/console.log" append="off"/>
Nov 14 11:07:16 user nova-compute[75255]:     </serial>
Nov 14 11:07:16 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:07:16 user nova-compute[75255]:     <video>
Nov 14 11:07:16 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:16 user nova-compute[75255]:     </video>
Nov 14 11:07:16 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:07:16 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:07:16 user nova-compute[75255]:     </rng>
Nov 14 11:07:16 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:07:16 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:07:16 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:07:16 user nova-compute[75255]:     </memballoon>
Nov 14 11:07:16 user nova-compute[75255]:   </devices>
Nov 14 11:07:16 user nova-compute[75255]: </domain>
Nov 14 11:07:16 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-994548043',display_name='tempest-VolumesAssistedSnapshotsTest-server-994548043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-994548043',id=9,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfiieOnhk+TkdK6HQDW3uzXl4qlxoCDsefMwv3ctlPF8IZqGpZxjgWb4wGY3jT42SNEnLW977OHmPQ2gRdrlceQFAJmidYeZ9S73SsHx1RJ6nMCpPtAfQ/UXVLjOFERYA==',key_name='tempest-keypair-1355363180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cd85bbe9945438bbeb05dddc2699c90',ramdisk_id='',reservation_id='r-xlefamvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1968772865',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1968772865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce374c4f13b942f6975f9a0f48297e8e',uuid=41aa15c1-08df-4bc5-907c-36790452a8af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Converting VIF {"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:23:c0,bridge_name='br-int',has_traffic_filtering=True,id=438aabcf-8c82-4604-a29b-fa5d012b879d,network=Network(bc8a8b7f-8112-406f-a729-95e316aed630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438aabcf-8c') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG os_vif [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:23:c0,bridge_name='br-int',has_traffic_filtering=True,id=438aabcf-8c82-4604-a29b-fa5d012b879d,network=Network(bc8a8b7f-8112-406f-a729-95e316aed630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438aabcf-8c') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2851ed7a-1200-50eb-bcb3-45a404fd0eb6', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap438aabcf-8c, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap438aabcf-8c, col_values=(('qos', UUID('91222435-88c6-4754-9f91-0593c862fea4')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap438aabcf-8c, col_values=(('external_ids', {'iface-id': '438aabcf-8c82-4604-a29b-fa5d012b879d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:23:c0', 'vm-uuid': '41aa15c1-08df-4bc5-907c-36790452a8af'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: INFO os_vif [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:23:c0,bridge_name='br-int',has_traffic_filtering=True,id=438aabcf-8c82-4604-a29b-fa5d012b879d,network=Network(bc8a8b7f-8112-406f-a729-95e316aed630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438aabcf-8c')
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] No VIF found with MAC fa:16:3e:24:23:c0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Updated VIF entry in instance network info cache for port 438aabcf-8c82-4604-a29b-fa5d012b879d. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Updating instance_info_cache with network_info: [{"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce3f6b45-95f1-4cb8-921d-4c635b8c5d02 req-6b0e6ebf-2413-4a0f-919a-474fe49bcda7 service nova] Releasing lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:07:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Instance spawned successfully.
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:18 user nova-compute[75255]: INFO nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Took 10.91 seconds to spawn the instance on the hypervisor.
Nov 14 11:07:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:18 user nova-compute[75255]: INFO nova.compute.manager [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Took 12.13 seconds to build instance.
Nov 14 11:07:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aedfad40-570b-4c8f-86dd-4f92fd07c7c0 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.284s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:07:20 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Instance spawned successfully.
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:20 user nova-compute[75255]: INFO nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Took 7.60 seconds to spawn the instance on the hypervisor.
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:07:20 user nova-compute[75255]: INFO nova.compute.manager [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Took 9.18 seconds to build instance.
Nov 14 11:07:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e222aed0-230c-4c70-9017-0b9761c12fe2 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.632s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-a81a29d4-9c05-40f6-8e74-7d729f976f6a req-a1e95cc1-b99e-4433-a483-8a194ab54620 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a81a29d4-9c05-40f6-8e74-7d729f976f6a req-a1e95cc1-b99e-4433-a483-8a194ab54620 service nova] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a81a29d4-9c05-40f6-8e74-7d729f976f6a req-a1e95cc1-b99e-4433-a483-8a194ab54620 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a81a29d4-9c05-40f6-8e74-7d729f976f6a req-a1e95cc1-b99e-4433-a483-8a194ab54620 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-a81a29d4-9c05-40f6-8e74-7d729f976f6a req-a1e95cc1-b99e-4433-a483-8a194ab54620 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] No waiting events found dispatching network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:20 user nova-compute[75255]: WARNING nova.compute.manager [req-a81a29d4-9c05-40f6-8e74-7d729f976f6a req-a1e95cc1-b99e-4433-a483-8a194ab54620 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received unexpected event network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d for instance with vm_state active and task_state None.
Nov 14 11:07:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-1cb3e8fd-2273-4b5b-8e26-decd17eef19c req-add503f7-e413-4281-a6f0-bafb7a4e380f service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1cb3e8fd-2273-4b5b-8e26-decd17eef19c req-add503f7-e413-4281-a6f0-bafb7a4e380f service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1cb3e8fd-2273-4b5b-8e26-decd17eef19c req-add503f7-e413-4281-a6f0-bafb7a4e380f service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1cb3e8fd-2273-4b5b-8e26-decd17eef19c req-add503f7-e413-4281-a6f0-bafb7a4e380f service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-1cb3e8fd-2273-4b5b-8e26-decd17eef19c req-add503f7-e413-4281-a6f0-bafb7a4e380f service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:21 user nova-compute[75255]: WARNING nova.compute.manager [req-1cb3e8fd-2273-4b5b-8e26-decd17eef19c req-add503f7-e413-4281-a6f0-bafb7a4e380f service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received unexpected event network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 for instance with vm_state active and task_state None.
Nov 14 11:07:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:07:22 user nova-compute[75255]: INFO nova.compute.claims [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Claim successful on node user
Nov 14 11:07:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-962bfd38-eaa8-42a6-9889-c6196c8bfffd req-1064607f-4a37-4619-9837-0de8476f7542 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-962bfd38-eaa8-42a6-9889-c6196c8bfffd req-1064607f-4a37-4619-9837-0de8476f7542 service nova] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-962bfd38-eaa8-42a6-9889-c6196c8bfffd req-1064607f-4a37-4619-9837-0de8476f7542 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-962bfd38-eaa8-42a6-9889-c6196c8bfffd req-1064607f-4a37-4619-9837-0de8476f7542 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-962bfd38-eaa8-42a6-9889-c6196c8bfffd req-1064607f-4a37-4619-9837-0de8476f7542 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] No waiting events found dispatching network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:22 user nova-compute[75255]: WARNING nova.compute.manager [req-962bfd38-eaa8-42a6-9889-c6196c8bfffd req-1064607f-4a37-4619-9837-0de8476f7542 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received unexpected event network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d for instance with vm_state active and task_state None.
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.776s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.094s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.policy [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b20309458694432394da4ee00f67638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39b62cd90bd47778d70766751118de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:07:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Creating image(s)
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "/opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "/opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "/opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "cdbf4f551ba331c76cda3a9147c1048a7010c934" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "cdbf4f551ba331c76cda3a9147c1048a7010c934" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-0853e127-8b05-4402-8f77-e8b51cda1f4d req-9e1a8074-7181-4a29-8fd3-78121d000522 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0853e127-8b05-4402-8f77-e8b51cda1f4d req-9e1a8074-7181-4a29-8fd3-78121d000522 service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0853e127-8b05-4402-8f77-e8b51cda1f4d req-9e1a8074-7181-4a29-8fd3-78121d000522 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0853e127-8b05-4402-8f77-e8b51cda1f4d req-9e1a8074-7181-4a29-8fd3-78121d000522 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-0853e127-8b05-4402-8f77-e8b51cda1f4d req-9e1a8074-7181-4a29-8fd3-78121d000522 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:23 user nova-compute[75255]: WARNING nova.compute.manager [req-0853e127-8b05-4402-8f77-e8b51cda1f4d req-9e1a8074-7181-4a29-8fd3-78121d000522 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received unexpected event network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 for instance with vm_state active and task_state None.
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.725s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.part --force-share --output=json" returned: 0 in 0.274s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG nova.virt.images [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] 6b185a70-d273-40c7-a522-1f344ff8db74 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.part /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.part /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.converted" returned: 0 in 0.222s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "cdbf4f551ba331c76cda3a9147c1048a7010c934" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.354s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json" returned: 0 in 0.215s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "cdbf4f551ba331c76cda3a9147c1048a7010c934" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "cdbf4f551ba331c76cda3a9147c1048a7010c934" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json" returned: 0 in 0.225s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934,backing_fmt=raw /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934,backing_fmt=raw /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk 1073741824" returned: 0 in 0.057s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "cdbf4f551ba331c76cda3a9147c1048a7010c934" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Successfully created port: b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json" returned: 0 in 0.245s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Cannot resize image /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Ensure instance console log exists: /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Successfully updated port: b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquired lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing instance network info cache due to event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] Acquiring lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Releasing lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance network_info: |[{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] Acquired lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.network.neutron [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Start _get_guest_xml network_info=[{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:07:18Z,direct_url=<?>,disk_format='qcow2',id=6b185a70-d273-40c7-a522-1f344ff8db74,min_disk=0,min_ram=0,name='tempest-scenario-img--173569040',owner='e39b62cd90bd47778d70766751118de4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:07:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '6b185a70-d273-40c7-a522-1f344ff8db74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:07:27 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:27 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:07:18Z,direct_url=<?>,disk_format='qcow2',id=6b185a70-d273-40c7-a522-1f344ff8db74,min_disk=0,min_ram=0,name='tempest-scenario-img--173569040',owner='e39b62cd90bd47778d70766751118de4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:07:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1740956480',display_name='tempest-TestMinimumBasicScenario-server-1740956480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1740956480',id=10,image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLubt+BEWN8kJ36V2h8+qu0AjZ1e+g52jEBZdUEat+zmfnZ0m8vxRP4cgbi6UlWVTZdExaSwyq7eCW1mS1l8yvsQy2f7NujuxCqk0iCfPN5M+6iuUYikHric6nqTEkCMkA==',key_name='tempest-TestMinimumBasicScenario-1185292113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-cmi4zxzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:23Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=844fb83b-7dc0-4720-bacc-52917c1d3c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'pci_devices' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:07:27 user nova-compute[75255]:   <uuid>844fb83b-7dc0-4720-bacc-52917c1d3c6e</uuid>
Nov 14 11:07:27 user nova-compute[75255]:   <name>instance-0000000a</name>
Nov 14 11:07:27 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:07:27 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:07:27 user nova-compute[75255]:   <metadata>
Nov 14 11:07:27 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:07:27 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:07:27 user nova-compute[75255]:       <nova:name>tempest-TestMinimumBasicScenario-server-1740956480</nova:name>
Nov 14 11:07:27 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:07:27</nova:creationTime>
Nov 14 11:07:27 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:07:27 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:07:27 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:07:27 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:07:27 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:07:27 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:07:27 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:07:27 user nova-compute[75255]:       <nova:owner>
Nov 14 11:07:27 user nova-compute[75255]:         <nova:user uuid="b20309458694432394da4ee00f67638b">tempest-TestMinimumBasicScenario-1092480951-project-member</nova:user>
Nov 14 11:07:27 user nova-compute[75255]:         <nova:project uuid="e39b62cd90bd47778d70766751118de4">tempest-TestMinimumBasicScenario-1092480951</nova:project>
Nov 14 11:07:27 user nova-compute[75255]:       </nova:owner>
Nov 14 11:07:27 user nova-compute[75255]:       <nova:root type="image" uuid="6b185a70-d273-40c7-a522-1f344ff8db74"/>
Nov 14 11:07:27 user nova-compute[75255]:       <nova:ports>
Nov 14 11:07:27 user nova-compute[75255]:         <nova:port uuid="b13a195e-5614-4f79-8037-b0a124f021dc">
Nov 14 11:07:27 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:07:27 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:27 user nova-compute[75255]:       </nova:ports>
Nov 14 11:07:27 user nova-compute[75255]:     </nova:instance>
Nov 14 11:07:27 user nova-compute[75255]:   </metadata>
Nov 14 11:07:27 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:07:27 user nova-compute[75255]:     <system>
Nov 14 11:07:27 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:07:27 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:07:27 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:07:27 user nova-compute[75255]:       <entry name="serial">844fb83b-7dc0-4720-bacc-52917c1d3c6e</entry>
Nov 14 11:07:27 user nova-compute[75255]:       <entry name="uuid">844fb83b-7dc0-4720-bacc-52917c1d3c6e</entry>
Nov 14 11:07:27 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:07:27 user nova-compute[75255]:     </system>
Nov 14 11:07:27 user nova-compute[75255]:   </sysinfo>
Nov 14 11:07:27 user nova-compute[75255]:   <os>
Nov 14 11:07:27 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:07:27 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:07:27 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:07:27 user nova-compute[75255]:   </os>
Nov 14 11:07:27 user nova-compute[75255]:   <features>
Nov 14 11:07:27 user nova-compute[75255]:     <acpi/>
Nov 14 11:07:27 user nova-compute[75255]:     <apic/>
Nov 14 11:07:27 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:07:27 user nova-compute[75255]:   </features>
Nov 14 11:07:27 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:07:27 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:07:27 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:07:27 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:07:27 user nova-compute[75255]:   </clock>
Nov 14 11:07:27 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:07:27 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:07:27 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:07:27 user nova-compute[75255]:   </cpu>
Nov 14 11:07:27 user nova-compute[75255]:   <devices>
Nov 14 11:07:27 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:07:27 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:07:27 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk"/>
Nov 14 11:07:27 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:07:27 user nova-compute[75255]:     </disk>
Nov 14 11:07:27 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:27 user nova-compute[75255]:       <mac address="fa:16:3e:98:94:4b"/>
Nov 14 11:07:27 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:27 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:27 user nova-compute[75255]:       <target dev="tapb13a195e-56"/>
Nov 14 11:07:27 user nova-compute[75255]:     </interface>
Nov 14 11:07:27 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:07:27 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/console.log" append="off"/>
Nov 14 11:07:27 user nova-compute[75255]:     </serial>
Nov 14 11:07:27 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:07:27 user nova-compute[75255]:     <video>
Nov 14 11:07:27 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:27 user nova-compute[75255]:     </video>
Nov 14 11:07:27 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:07:27 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:07:27 user nova-compute[75255]:     </rng>
Nov 14 11:07:27 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:07:27 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:07:27 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:07:27 user nova-compute[75255]:     </memballoon>
Nov 14 11:07:27 user nova-compute[75255]:   </devices>
Nov 14 11:07:27 user nova-compute[75255]: </domain>
Nov 14 11:07:27 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1740956480',display_name='tempest-TestMinimumBasicScenario-server-1740956480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1740956480',id=10,image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLubt+BEWN8kJ36V2h8+qu0AjZ1e+g52jEBZdUEat+zmfnZ0m8vxRP4cgbi6UlWVTZdExaSwyq7eCW1mS1l8yvsQy2f7NujuxCqk0iCfPN5M+6iuUYikHric6nqTEkCMkA==',key_name='tempest-TestMinimumBasicScenario-1185292113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-cmi4zxzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:23Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=844fb83b-7dc0-4720-bacc-52917c1d3c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG os_vif [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c8f46e5-03f4-5728-9039-51611badcb95', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb13a195e-56, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb13a195e-56, col_values=(('qos', UUID('e07d3f7f-2cfe-43e5-92a7-68ba6b358495')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb13a195e-56, col_values=(('external_ids', {'iface-id': 'b13a195e-5614-4f79-8037-b0a124f021dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:94:4b', 'vm-uuid': '844fb83b-7dc0-4720-bacc-52917c1d3c6e'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:27 user nova-compute[75255]: INFO os_vif [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56')
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No VIF found with MAC fa:16:3e:98:94:4b, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:07:27 user nova-compute[75255]: INFO nova.compute.claims [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Claim successful on node user
Nov 14 11:07:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updated VIF entry in instance network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fee92944-a0b0-4eae-aeca-f75549e1a010 req-5ca7c6d1-094c-4942-b0f0-9b724304a2ec service nova] Releasing lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-077bcb9e-9671-4ec6-aa6c-986e9a576156 req-943a7668-66bd-4873-93d8-e39cf3f5edec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-077bcb9e-9671-4ec6-aa6c-986e9a576156 req-943a7668-66bd-4873-93d8-e39cf3f5edec service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-077bcb9e-9671-4ec6-aa6c-986e9a576156 req-943a7668-66bd-4873-93d8-e39cf3f5edec service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-077bcb9e-9671-4ec6-aa6c-986e9a576156 req-943a7668-66bd-4873-93d8-e39cf3f5edec service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-077bcb9e-9671-4ec6-aa6c-986e9a576156 req-943a7668-66bd-4873-93d8-e39cf3f5edec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:31 user nova-compute[75255]: WARNING nova.compute.manager [req-077bcb9e-9671-4ec6-aa6c-986e9a576156 req-943a7668-66bd-4873-93d8-e39cf3f5edec service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received unexpected event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with vm_state building and task_state spawning.
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:07:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance spawned successfully.
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:07:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7614MB free_disk=25.532970428466797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-1eeb56b3-e845-49e2-8d0b-c127a38b56ca req-28b90960-56ae-4040-b602-32b8fc462eea service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1eeb56b3-e845-49e2-8d0b-c127a38b56ca req-28b90960-56ae-4040-b602-32b8fc462eea service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1eeb56b3-e845-49e2-8d0b-c127a38b56ca req-28b90960-56ae-4040-b602-32b8fc462eea service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1eeb56b3-e845-49e2-8d0b-c127a38b56ca req-28b90960-56ae-4040-b602-32b8fc462eea service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-1eeb56b3-e845-49e2-8d0b-c127a38b56ca req-28b90960-56ae-4040-b602-32b8fc462eea service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:31 user nova-compute[75255]: WARNING nova.compute.manager [req-1eeb56b3-e845-49e2-8d0b-c127a38b56ca req-28b90960-56ae-4040-b602-32b8fc462eea service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received unexpected event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with vm_state building and task_state spawning.
Nov 14 11:07:31 user nova-compute[75255]: INFO nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Took 8.16 seconds to spawn the instance on the hypervisor.
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.915s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.234s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:07:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:07:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.policy [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c78dd6817bd04c3b9a6b5111a374291e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13439f3ceb84c0ebecc39beabbfb147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:07:32 user nova-compute[75255]: INFO nova.compute.manager [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Took 9.75 seconds to build instance.
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5fbff6d6-71be-4433-8e41-6cb3d597594e tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.881s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:07:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Creating image(s)
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "/opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "/opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "/opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.037s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 41aa15c1-08df-4bc5-907c-36790452a8af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2ce264fc-cc38-421a-92ae-41dc6174745d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 722f579b-576b-4154-b380-7fc78dc7b9b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d7f63547-b356-471b-825d-6a0b4670221d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2e186944-c41d-4f07-b852-ff17b2241241 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.301s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.235s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk 1073741824" returned: 0 in 0.072s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Successfully created port: ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:07:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.093s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Cannot resize image /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Ensure instance console log exists: /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Successfully updated port: ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-changed-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Refreshing instance network info cache due to event network-changed-ea464f49-6b78-450d-9b10-124c0e2a31d7. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] Acquiring lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] Acquired lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.network.neutron [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Refreshing network info cache for port ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:33 user nova-compute[75255]: DEBUG nova.network.neutron [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:07:34 user nova-compute[75255]: INFO nova.compute.claims [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Claim successful on node user
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ec06d0a4-5ffe-4c63-baa1-aa73e5f3315d req-fade4906-6f36-4d42-996e-37fc7b087705 service nova] Releasing lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquired lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Updating instance_info_cache with network_info: [{"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Releasing lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Instance network_info: |[{"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Start _get_guest_xml network_info=[{"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:07:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695545729',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695545729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1695545',id=11,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnORozttTzsSGpCeBLm+tK5XkeAFW3iBiYed5/wu3T7bYBI4GHF16kyhW0ccGW2/IVrMEX46UYAEBCQnaYPqkRhZVLG5PKVUY4BWEbvuTW9NaV9ouZ38tHXg7+hXOFx3g==',key_name='tempest-keypair-1580192274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13439f3ceb84c0ebecc39beabbfb147',ramdisk_id='',reservation_id='r-ob8mi06u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1234251449',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78dd6817bd04c3b9a6b5111a374291e',uuid=71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Converting VIF {"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:a4,bridge_name='br-int',has_traffic_filtering=True,id=ea464f49-6b78-450d-9b10-124c0e2a31d7,network=Network(5caf9330-fb73-4c61-bb18-6b6be5f7af8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea464f49-6b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lazy-loading 'pci_devices' on Instance uuid 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:07:34 user nova-compute[75255]:   <uuid>71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2</uuid>
Nov 14 11:07:34 user nova-compute[75255]:   <name>instance-0000000b</name>
Nov 14 11:07:34 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:07:34 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:07:34 user nova-compute[75255]:   <metadata>
Nov 14 11:07:34 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:07:34 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:07:34 user nova-compute[75255]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1695545729</nova:name>
Nov 14 11:07:34 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:07:34</nova:creationTime>
Nov 14 11:07:34 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:07:34 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:07:34 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:07:34 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:07:34 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:07:34 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:07:34 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:07:34 user nova-compute[75255]:       <nova:owner>
Nov 14 11:07:34 user nova-compute[75255]:         <nova:user uuid="c78dd6817bd04c3b9a6b5111a374291e">tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member</nova:user>
Nov 14 11:07:34 user nova-compute[75255]:         <nova:project uuid="b13439f3ceb84c0ebecc39beabbfb147">tempest-TestServerVolumeAttachScenarioOldVersion-1234251449</nova:project>
Nov 14 11:07:34 user nova-compute[75255]:       </nova:owner>
Nov 14 11:07:34 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:07:34 user nova-compute[75255]:       <nova:ports>
Nov 14 11:07:34 user nova-compute[75255]:         <nova:port uuid="ea464f49-6b78-450d-9b10-124c0e2a31d7">
Nov 14 11:07:34 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 11:07:34 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:34 user nova-compute[75255]:       </nova:ports>
Nov 14 11:07:34 user nova-compute[75255]:     </nova:instance>
Nov 14 11:07:34 user nova-compute[75255]:   </metadata>
Nov 14 11:07:34 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:07:34 user nova-compute[75255]:     <system>
Nov 14 11:07:34 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:07:34 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:07:34 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:07:34 user nova-compute[75255]:       <entry name="serial">71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2</entry>
Nov 14 11:07:34 user nova-compute[75255]:       <entry name="uuid">71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2</entry>
Nov 14 11:07:34 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:07:34 user nova-compute[75255]:     </system>
Nov 14 11:07:34 user nova-compute[75255]:   </sysinfo>
Nov 14 11:07:34 user nova-compute[75255]:   <os>
Nov 14 11:07:34 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:07:34 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:07:34 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:07:34 user nova-compute[75255]:   </os>
Nov 14 11:07:34 user nova-compute[75255]:   <features>
Nov 14 11:07:34 user nova-compute[75255]:     <acpi/>
Nov 14 11:07:34 user nova-compute[75255]:     <apic/>
Nov 14 11:07:34 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:07:34 user nova-compute[75255]:   </features>
Nov 14 11:07:34 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:07:34 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:07:34 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:07:34 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:07:34 user nova-compute[75255]:   </clock>
Nov 14 11:07:34 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:07:34 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:07:34 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:07:34 user nova-compute[75255]:   </cpu>
Nov 14 11:07:34 user nova-compute[75255]:   <devices>
Nov 14 11:07:34 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:07:34 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:07:34 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk"/>
Nov 14 11:07:34 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:07:34 user nova-compute[75255]:     </disk>
Nov 14 11:07:34 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:34 user nova-compute[75255]:       <mac address="fa:16:3e:8c:71:a4"/>
Nov 14 11:07:34 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:34 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:34 user nova-compute[75255]:       <target dev="tapea464f49-6b"/>
Nov 14 11:07:34 user nova-compute[75255]:     </interface>
Nov 14 11:07:34 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:07:34 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/console.log" append="off"/>
Nov 14 11:07:34 user nova-compute[75255]:     </serial>
Nov 14 11:07:34 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:07:34 user nova-compute[75255]:     <video>
Nov 14 11:07:34 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:34 user nova-compute[75255]:     </video>
Nov 14 11:07:34 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:07:34 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:07:34 user nova-compute[75255]:     </rng>
Nov 14 11:07:34 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:07:34 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:07:34 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:07:34 user nova-compute[75255]:     </memballoon>
Nov 14 11:07:34 user nova-compute[75255]:   </devices>
Nov 14 11:07:34 user nova-compute[75255]: </domain>
Nov 14 11:07:34 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695545729',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695545729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1695545',id=11,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnORozttTzsSGpCeBLm+tK5XkeAFW3iBiYed5/wu3T7bYBI4GHF16kyhW0ccGW2/IVrMEX46UYAEBCQnaYPqkRhZVLG5PKVUY4BWEbvuTW9NaV9ouZ38tHXg7+hXOFx3g==',key_name='tempest-keypair-1580192274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13439f3ceb84c0ebecc39beabbfb147',ramdisk_id='',reservation_id='r-ob8mi06u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1234251449',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78dd6817bd04c3b9a6b5111a374291e',uuid=71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Converting VIF {"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:a4,bridge_name='br-int',has_traffic_filtering=True,id=ea464f49-6b78-450d-9b10-124c0e2a31d7,network=Network(5caf9330-fb73-4c61-bb18-6b6be5f7af8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea464f49-6b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG os_vif [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:a4,bridge_name='br-int',has_traffic_filtering=True,id=ea464f49-6b78-450d-9b10-124c0e2a31d7,network=Network(5caf9330-fb73-4c61-bb18-6b6be5f7af8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea464f49-6b') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-ba132667-1629-4788-a012-0d398f53541f req-7d81975d-19a3-4e70-b24d-edef3d90557f service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ba132667-1629-4788-a012-0d398f53541f req-7d81975d-19a3-4e70-b24d-edef3d90557f service nova] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ba132667-1629-4788-a012-0d398f53541f req-7d81975d-19a3-4e70-b24d-edef3d90557f service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ba132667-1629-4788-a012-0d398f53541f req-7d81975d-19a3-4e70-b24d-edef3d90557f service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-ba132667-1629-4788-a012-0d398f53541f req-7d81975d-19a3-4e70-b24d-edef3d90557f service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] No waiting events found dispatching network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:34 user nova-compute[75255]: WARNING nova.compute.manager [req-ba132667-1629-4788-a012-0d398f53541f req-7d81975d-19a3-4e70-b24d-edef3d90557f service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received unexpected event network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e for instance with vm_state active and task_state None.
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6c00b1f-eaad-54d3-8dfb-4986b48980f7', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea464f49-6b, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea464f49-6b, col_values=(('qos', UUID('de166419-f404-42c0-8109-834b9eff8e51')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea464f49-6b, col_values=(('external_ids', {'iface-id': 'ea464f49-6b78-450d-9b10-124c0e2a31d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:71:a4', 'vm-uuid': '71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:34 user nova-compute[75255]: INFO os_vif [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:a4,bridge_name='br-int',has_traffic_filtering=True,id=ea464f49-6b78-450d-9b10-124c0e2a31d7,network=Network(5caf9330-fb73-4c61-bb18-6b6be5f7af8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea464f49-6b')
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] No VIF found with MAC fa:16:3e:8c:71:a4, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:07:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:07:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Skipping network cache update for instance because it is Building. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Skipping network cache update for instance because it is Building. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.policy [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4365022be23e49c7a122158e94374783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63de7810264641c9a368882026712330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:07:35 user nova-compute[75255]: INFO nova.virt.block_device [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Booting with volume 9454981f-b852-4a03-a67e-bd2caf6f8b49 at /dev/vda
Nov 14 11:07:35 user nova-compute[75255]: DEBUG os_brick.utils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:07:35 user nova-compute[75255]: INFO oslo.privsep.daemon [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpvnsk9bkq/privsep.sock']
Nov 14 11:07:35 user sudo[86415]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpvnsk9bkq/privsep.sock
Nov 14 11:07:35 user sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:07:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully created port: c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] No waiting events found dispatching network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:36 user nova-compute[75255]: WARNING nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received unexpected event network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e for instance with vm_state active and task_state None.
Nov 14 11:07:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] No waiting events found dispatching network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:36 user nova-compute[75255]: WARNING nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received unexpected event network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb for instance with vm_state active and task_state None.
Nov 14 11:07:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] No waiting events found dispatching network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:36 user nova-compute[75255]: WARNING nova.compute.manager [req-b445e5fc-53f9-4e83-9057-ac4f4f65984d req-0a950791-e4a7-4ffb-b79e-b09d0a938c85 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received unexpected event network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb for instance with vm_state active and task_state None.
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user sudo[86415]: pam_unix(sudo:session): session closed for user root
Nov 14 11:07:37 user nova-compute[75255]: INFO oslo.privsep.daemon [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Spawned new privsep daemon via rootwrap
Nov 14 11:07:37 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 11:07:37 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 11:07:37 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 11:07:37 user nova-compute[75255]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86497
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4472b4-00e0-4666-aa47-fa218f5c5833]: (2,) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully created port: 84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-db4e567d-8412-4c0e-81cf-fa0070649b3b req-f0a6ddb7-d679-43b0-9dae-17413eb958cd service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-db4e567d-8412-4c0e-81cf-fa0070649b3b req-f0a6ddb7-d679-43b0-9dae-17413eb958cd service nova] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-db4e567d-8412-4c0e-81cf-fa0070649b3b req-f0a6ddb7-d679-43b0-9dae-17413eb958cd service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-db4e567d-8412-4c0e-81cf-fa0070649b3b req-f0a6ddb7-d679-43b0-9dae-17413eb958cd service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-db4e567d-8412-4c0e-81cf-fa0070649b3b req-f0a6ddb7-d679-43b0-9dae-17413eb958cd service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] No waiting events found dispatching network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:37 user nova-compute[75255]: WARNING nova.compute.manager [req-db4e567d-8412-4c0e-81cf-fa0070649b3b req-f0a6ddb7-d679-43b0-9dae-17413eb958cd service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received unexpected event network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 for instance with vm_state building and task_state spawning.
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6004be2-4123-4a80-8aff-6b0475b9b8ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:37 user nova-compute[75255]: WARNING os_brick.initiator.connectors.nvmeof [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.038s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3a322b-9c1a-40f3-b710-95332df93950]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1cf37-2a2a-4bb6-8341-0c810fa48c0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ab741-f925-42df-a444-6d9f3d3b6868]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:07:37 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:07:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[22add4f7-0a5b-48c1-ad34-74a7a1ccc130]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG os_brick.utils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== get_connector_properties: return (2244ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating existing volume attachment record: 63a087c1-e946-4727-bb02-ca74006fb5ac {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully created port: 819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully created port: 7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully created port: a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-641ad49a-f663-4ed0-b405-9557aa9a016a req-be433e85-5b48-4d87-9b8d-6e58f8d61a4d service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-641ad49a-f663-4ed0-b405-9557aa9a016a req-be433e85-5b48-4d87-9b8d-6e58f8d61a4d service nova] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-641ad49a-f663-4ed0-b405-9557aa9a016a req-be433e85-5b48-4d87-9b8d-6e58f8d61a4d service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-641ad49a-f663-4ed0-b405-9557aa9a016a req-be433e85-5b48-4d87-9b8d-6e58f8d61a4d service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-641ad49a-f663-4ed0-b405-9557aa9a016a req-be433e85-5b48-4d87-9b8d-6e58f8d61a4d service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] No waiting events found dispatching network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:07:39 user nova-compute[75255]: WARNING nova.compute.manager [req-641ad49a-f663-4ed0-b405-9557aa9a016a req-be433e85-5b48-4d87-9b8d-6e58f8d61a4d service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received unexpected event network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 for instance with vm_state building and task_state spawning.
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:07:39 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Instance spawned successfully.
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:07:39 user nova-compute[75255]: INFO nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully updated port: c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:39 user nova-compute[75255]: INFO nova.compute.manager [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Took 11.92 seconds to build instance.
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-c66c1d61-b2d6-4e34-956a-15992fd14efd. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.network.neutron [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2ff4d8e0-b684-457d-99e3-bb53c9c8293c tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.249s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.network.neutron [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:39 user nova-compute[75255]: DEBUG nova.network.neutron [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-634366d1-c31a-49d5-a538-3885603de053 req-986be89a-c59e-402c-94db-79adfc9df725 service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:40 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully updated port: 4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully updated port: 160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG nova.network.neutron [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port 4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG nova.network.neutron [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully updated port: 84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:41 user nova-compute[75255]: DEBUG nova.network.neutron [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG nova.compute.manager [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG nova.compute.manager [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-160d9580-cfb1-4334-9d6b-c5462e9ead29. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG nova.network.neutron [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port 160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG nova.network.neutron [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG nova.network.neutron [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-832d2ee0-0fe5-4b63-b9e5-e078b1b17a7d req-64c8ba6f-b3de-46a8-8246-95ed7235f7b3 service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:42 user nova-compute[75255]: INFO nova.virt.block_device [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Booting with volume 2cb837ec-8ad2-49c3-a3cf-243f28582add at /dev/vdb
Nov 14 11:07:43 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully updated port: 819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG os_brick.utils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a780a29-6034-4115-aae8-87b712f8615b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97448f4-0e5d-4675-9439-8b9892e5f541]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe25f01-494c-4775-8e84-cf9d38a6f3ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a9e96-3728-407a-b942-a675cf87caa9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:07:43 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac237df-b16c-442b-a62b-8785b6913bce]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG os_brick.utils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating existing volume attachment record: 68401fa4-42c1-4b83-964d-335e0ad3e4a8 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-84a98f26-6223-481f-9a63-c43d1488ee23. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port 84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully updated port: 7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.network.neutron [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-819f1bdc-383e-47b7-9838-254fd3a6f250. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.network.neutron [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port 819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.network.neutron [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Successfully updated port: a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.network.neutron [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a962ec00-32b1-4590-8fa6-54a7a38df405 req-f2c7fbfc-6150-4454-9585-200551252d71 service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:07:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance network_info: |[{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:07:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:46 user nova-compute[75255]: DEBUG nova.network.neutron [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port 7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG nova.network.neutron [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updated VIF entry in instance network info cache for port 7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG nova.network.neutron [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-a40baa56-0996-464c-a813-0bc924afa2fd. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG nova.network.neutron [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG nova.network.neutron [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updated VIF entry in instance network info cache for port a40baa56-0996-464c-a813-0bc924afa2fd. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG nova.network.neutron [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:07:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f55f8920-3798-4425-a5a0-a082638ec021 req-9cad352b-3566-4811-a1b1-8f2c46a6e926 service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:48 user nova-compute[75255]: INFO nova.virt.block_device [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Booting with volume 774cd9b8-edfe-448f-9853-ad01c2e1520e at /dev/vdc
Nov 14 11:07:48 user nova-compute[75255]: DEBUG os_brick.utils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[686603e2-d4d2-45d7-ab35-41c6e2ecced6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5b2a8-526c-4001-9000-039ee66d6263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[157c914a-0554-4d8b-a1bc-24ef04c3f2d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba983267-574b-48aa-8b32-bcb7fcbc2b47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:07:48 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:07:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f57e28-5be0-4f8b-bad5-bf2ea1d21b4e]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG os_brick.utils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:07:48 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating existing volume attachment record: ea97b471-b3e4-4f94-bdc3-9bbb7379c94e {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:07:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:07:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Creating image(s)
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Ensure instance console log exists: /opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Start _get_guest_xml network_info=[{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '63a087c1-e946-4727-bb02-ca74006fb5ac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOyXEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d', 'attached_at': '', 'detached_at': '', 'volume_id': '9454981f-b852-4a03-a67e-bd2caf6f8b49', 'serial': '9454981f-b852-4a03-a67e-bd2caf6f8b49'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '68401fa4-42c1-4b83-964d-335e0ad3e4a8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVHyrTiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d', 'attached_at': '', 'detached_at': '', 'volume_id': '2cb837ec-8ad2-49c3-a3cf-243f28582add', 'serial': '2cb837ec-8ad2-49c3-a3cf-243f28582add'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ea97b471-b3e4-4f94-bdc3-9bbb7379c94e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsnqiQMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d', 'attached_at': '', 'detached_at': '', 'volume_id': '774cd9b8-edfe-448f-9853-ad01c2e1520e', 'serial': '774cd9b8-edfe-448f-9853-ad01c2e1520e'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:07:53 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:53 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connector [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Factory for ISCSI on None {{(pid=75255) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOyXEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:07:53 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:07:53 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:07:53 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[668fac09-4ff3-44c0-8e82-846fa4b432ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:07:53 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc54e03-d8e4-4aa0-9602-6699b20b873a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49] added
Nov 14 11:07:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4942bfa8-93a9-4acf-ba42-9fe8272597d5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57071ee-67b6-429a-baf9-a16205e6e5a8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfOyXEBc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfOyXEBc" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1034d3d2-372b-4cea-b154-6db09f4d9053]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pfOyXEBc'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f91157-02d3-4d8d-8f6d-376b070d251c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2031a2fc-496b-44cd-876c-60b78d67b603]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:07:54 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:07:54 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:07:54 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:07:54 user nova-compute[75255]: 
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[def06d41-1267-412c-9c6f-55ce8b35c995]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260]
Nov 14 11:07:54 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260] successful.
Nov 14 11:07:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a399d583-b3e6-404b-bcb3-00818ee2b98b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f578286-c69a-4785-8620-e0fd194a47b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3fbeb6-5c5f-4259-a051-46f30c6c8875]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOyXEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:07:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23365366131643231', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365366131643231', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVHyrTiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:07:55 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:07:55 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:07:55 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0200d477-1483-4262-acce-17ddd13847dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:07:55 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[73969c03-8afe-4359-a6dc-dc9f33022591]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add] added
Nov 14 11:07:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[22563376-9804-4deb-9199-f46c30e1679b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3136d52-7dd2-4ffd-86b3-bdf7729638e5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVHyrTiB {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVHyrTiB" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d1f851-598f-455f-b99c-652fdf9d4a5b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dVHyrTiB'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12ee1d9-1d1a-4edb-801a-fa8cd8ee6f69]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0e9ef9-1b9f-4740-a76c-a436c15f3ae7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae4d94-1e91-4339-aed6-2e311461b4e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260]
Nov 14 11:07:55 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260] successful.
Nov 14 11:07:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e406a0-645e-491e-920b-5af6bb931498]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e112af-7b26-4358-9b0d-28a579e4b4f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:55 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:07:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:55 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:07:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d5c283-8b4e-4399-9466-93ca32a1a076]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:07:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVHyrTiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23936613764356434', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936613764356434', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsnqiQMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:07:56 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:07:56 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:07:56 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e7a84a-eae2-4a59-b9a3-73849c292850]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:07:56 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c8ff2e-4aa9-4b20-95e5-0d571fc99891]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e] added
Nov 14 11:07:56 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d631d8-7021-474b-9011-11d6d540b58e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f956f-fa1e-4f08-9c9c-b8e0e517a085]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsnqiQMy {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsnqiQMy" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924bf97-d456-4d75-8e1a-617e5c305881]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SsnqiQMy'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf5227-da2a-4fc6-9c35-e77492100e54]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a849b416-6da0-426e-b99b-434d9d91d64d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:56 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:07:56 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:56 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:07:56 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19a0742-3d49-4a51-b775-3e8d4a443d9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260]
Nov 14 11:07:56 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260] successful.
Nov 14 11:07:56 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956bcf2-9376-41c9-a342-6d558a8c715f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc164d50-c958-4822-9643-988ef74a9bcf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:56 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:07:56 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:07:56 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:07:56 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:07:56 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:07:56 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad28bc3a-57c4-466d-aad4-067daa347303]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:07:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsnqiQMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26465346231343637', 'path': '/dev/sdd'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465346231343637', 'path': '/dev/sdd'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=c66c1d61-b2d6-4e34-956a-15992fd14efd,network=Network(bcc6ae6e-b2ee-4a76-b007-b9314f4fe225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66c1d61-b2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b4c9578-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1b:b4,bridge_name='br-int',has_traffic_filtering=True,id=160d9580-cfb1-4334-9d6b-c5462e9ead29,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap160d9580-cf') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a5:f7,bridge_name='br-int',has_traffic_filtering=True,id=84a98f26-6223-481f-9a63-c43d1488ee23,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a98f26-62') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=819f1bdc-383e-47b7-9838-254fd3a6f250,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819f1bdc-38') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:25,bridge_name='br-int',has_traffic_filtering=True,id=7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba68e0e-ea') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f5:f5,bridge_name='br-int',has_traffic_filtering=True,id=a40baa56-0996-464c-a813-0bc924afa2fd,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40baa56-09') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fa124c3-9e3a-418f-bc95-6bce20b5e47d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:07:58 user nova-compute[75255]:   <uuid>3fa124c3-9e3a-418f-bc95-6bce20b5e47d</uuid>
Nov 14 11:07:58 user nova-compute[75255]:   <name>instance-0000000c</name>
Nov 14 11:07:58 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:07:58 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:07:58 user nova-compute[75255]:   <metadata>
Nov 14 11:07:58 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:07:58 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:07:58 user nova-compute[75255]:       <nova:name>tempest-device-tagging-server-1936339914</nova:name>
Nov 14 11:07:58 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:07:53</nova:creationTime>
Nov 14 11:07:58 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:07:58 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:07:58 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:07:58 user nova-compute[75255]:       <nova:owner>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:user uuid="4365022be23e49c7a122158e94374783">tempest-TaggedBootDevicesTest-1699162693-project-member</nova:user>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:project uuid="63de7810264641c9a368882026712330">tempest-TaggedBootDevicesTest-1699162693</nova:project>
Nov 14 11:07:58 user nova-compute[75255]:       </nova:owner>
Nov 14 11:07:58 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:07:58 user nova-compute[75255]:       <nova:ports>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:port uuid="c66c1d61-b2d6-4e34-956a-15992fd14efd">
Nov 14 11:07:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 11:07:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:port uuid="4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8">
Nov 14 11:07:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Nov 14 11:07:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:port uuid="160d9580-cfb1-4334-9d6b-c5462e9ead29">
Nov 14 11:07:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Nov 14 11:07:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:port uuid="84a98f26-6223-481f-9a63-c43d1488ee23">
Nov 14 11:07:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Nov 14 11:07:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:port uuid="819f1bdc-383e-47b7-9838-254fd3a6f250">
Nov 14 11:07:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
Nov 14 11:07:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:port uuid="7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e">
Nov 14 11:07:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 11:07:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:58 user nova-compute[75255]:         <nova:port uuid="a40baa56-0996-464c-a813-0bc924afa2fd">
Nov 14 11:07:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 11:07:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:07:58 user nova-compute[75255]:       </nova:ports>
Nov 14 11:07:58 user nova-compute[75255]:     </nova:instance>
Nov 14 11:07:58 user nova-compute[75255]:   </metadata>
Nov 14 11:07:58 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:07:58 user nova-compute[75255]:     <system>
Nov 14 11:07:58 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:07:58 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:07:58 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:07:58 user nova-compute[75255]:       <entry name="serial">3fa124c3-9e3a-418f-bc95-6bce20b5e47d</entry>
Nov 14 11:07:58 user nova-compute[75255]:       <entry name="uuid">3fa124c3-9e3a-418f-bc95-6bce20b5e47d</entry>
Nov 14 11:07:58 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:07:58 user nova-compute[75255]:     </system>
Nov 14 11:07:58 user nova-compute[75255]:   </sysinfo>
Nov 14 11:07:58 user nova-compute[75255]:   <os>
Nov 14 11:07:58 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:07:58 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:07:58 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:07:58 user nova-compute[75255]:   </os>
Nov 14 11:07:58 user nova-compute[75255]:   <features>
Nov 14 11:07:58 user nova-compute[75255]:     <acpi/>
Nov 14 11:07:58 user nova-compute[75255]:     <apic/>
Nov 14 11:07:58 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:07:58 user nova-compute[75255]:   </features>
Nov 14 11:07:58 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:07:58 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:07:58 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:07:58 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:07:58 user nova-compute[75255]:   </clock>
Nov 14 11:07:58 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:07:58 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:07:58 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:07:58 user nova-compute[75255]:   </cpu>
Nov 14 11:07:58 user nova-compute[75255]:   <devices>
Nov 14 11:07:58 user nova-compute[75255]:     <disk type="file" device="cdrom">
Nov 14 11:07:58 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 11:07:58 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d/disk.config"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="hda" bus="ide"/>
Nov 14 11:07:58 user nova-compute[75255]:     </disk>
Nov 14 11:07:58 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:07:58 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:07:58 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <serial>9454981f-b852-4a03-a67e-bd2caf6f8b49</serial>
Nov 14 11:07:58 user nova-compute[75255]:     </disk>
Nov 14 11:07:58 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:07:58 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:07:58 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <serial>2cb837ec-8ad2-49c3-a3cf-243f28582add</serial>
Nov 14 11:07:58 user nova-compute[75255]:     </disk>
Nov 14 11:07:58 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:07:58 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:07:58 user nova-compute[75255]:       <source dev="/dev/sdd"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="vdc" bus="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <serial>774cd9b8-edfe-448f-9853-ad01c2e1520e</serial>
Nov 14 11:07:58 user nova-compute[75255]:     </disk>
Nov 14 11:07:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:58 user nova-compute[75255]:       <mac address="fa:16:3e:11:91:b0"/>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="tapc66c1d61-b2"/>
Nov 14 11:07:58 user nova-compute[75255]:     </interface>
Nov 14 11:07:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:58 user nova-compute[75255]:       <mac address="fa:16:3e:84:32:f3"/>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="tap4b4c9578-8a"/>
Nov 14 11:07:58 user nova-compute[75255]:     </interface>
Nov 14 11:07:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:58 user nova-compute[75255]:       <mac address="fa:16:3e:66:1b:b4"/>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="tap160d9580-cf"/>
Nov 14 11:07:58 user nova-compute[75255]:     </interface>
Nov 14 11:07:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:58 user nova-compute[75255]:       <mac address="fa:16:3e:26:a5:f7"/>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="tap84a98f26-62"/>
Nov 14 11:07:58 user nova-compute[75255]:     </interface>
Nov 14 11:07:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:58 user nova-compute[75255]:       <mac address="fa:16:3e:2e:2e:04"/>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="tap819f1bdc-38"/>
Nov 14 11:07:58 user nova-compute[75255]:     </interface>
Nov 14 11:07:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:58 user nova-compute[75255]:       <mac address="fa:16:3e:ed:eb:25"/>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="tap7ba68e0e-ea"/>
Nov 14 11:07:58 user nova-compute[75255]:     </interface>
Nov 14 11:07:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:07:58 user nova-compute[75255]:       <mac address="fa:16:3e:ba:f5:f5"/>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:07:58 user nova-compute[75255]:       <target dev="tapa40baa56-09"/>
Nov 14 11:07:58 user nova-compute[75255]:     </interface>
Nov 14 11:07:58 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:07:58 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d/console.log" append="off"/>
Nov 14 11:07:58 user nova-compute[75255]:     </serial>
Nov 14 11:07:58 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:07:58 user nova-compute[75255]:     <video>
Nov 14 11:07:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:07:58 user nova-compute[75255]:     </video>
Nov 14 11:07:58 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:07:58 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:07:58 user nova-compute[75255]:     </rng>
Nov 14 11:07:58 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:07:58 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:07:58 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:07:58 user nova-compute[75255]:     </memballoon>
Nov 14 11:07:58 user nova-compute[75255]:   </devices>
Nov 14 11:07:58 user nova-compute[75255]: </domain>
Nov 14 11:07:58 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=c66c1d61-b2d6-4e34-956a-15992fd14efd,network=Network(bcc6ae6e-b2ee-4a76-b007-b9314f4fe225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66c1d61-b2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=c66c1d61-b2d6-4e34-956a-15992fd14efd,network=Network(bcc6ae6e-b2ee-4a76-b007-b9314f4fe225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66c1d61-b2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e75b68f-f481-51bf-8b6d-c7d7042eed58', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66c1d61-b2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66c1d61-b2, col_values=(('qos', UUID('6a4a9b10-bf83-4a8a-b50a-e21a3be7a43d')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66c1d61-b2, col_values=(('external_ids', {'iface-id': 'c66c1d61-b2d6-4e34-956a-15992fd14efd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:91:b0', 'vm-uuid': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: INFO os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=c66c1d61-b2d6-4e34-956a-15992fd14efd,network=Network(bcc6ae6e-b2ee-4a76-b007-b9314f4fe225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66c1d61-b2')
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b4c9578-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b4c9578-8a') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1a83177-420c-5286-9003-a9d492d66a70', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b4c9578-8a, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b4c9578-8a, col_values=(('qos', UUID('1c6c496d-0363-4e7c-a40f-1efd8e20d513')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b4c9578-8a, col_values=(('external_ids', {'iface-id': '4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:32:f3', 'vm-uuid': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: INFO os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b4c9578-8a')
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1b:b4,bridge_name='br-int',has_traffic_filtering=True,id=160d9580-cfb1-4334-9d6b-c5462e9ead29,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap160d9580-cf') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1b:b4,bridge_name='br-int',has_traffic_filtering=True,id=160d9580-cfb1-4334-9d6b-c5462e9ead29,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap160d9580-cf') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c26bfedb-5091-5185-97f6-080ea2e8d2f3', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap160d9580-cf, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap160d9580-cf, col_values=(('qos', UUID('7e821876-0cb9-4d84-a40e-b357317d453c')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap160d9580-cf, col_values=(('external_ids', {'iface-id': '160d9580-cfb1-4334-9d6b-c5462e9ead29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:1b:b4', 'vm-uuid': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: INFO os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1b:b4,bridge_name='br-int',has_traffic_filtering=True,id=160d9580-cfb1-4334-9d6b-c5462e9ead29,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap160d9580-cf')
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a5:f7,bridge_name='br-int',has_traffic_filtering=True,id=84a98f26-6223-481f-9a63-c43d1488ee23,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a98f26-62') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a5:f7,bridge_name='br-int',has_traffic_filtering=True,id=84a98f26-6223-481f-9a63-c43d1488ee23,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a98f26-62') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f12d09d0-53c8-5bcb-a348-0c69e84789d0', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84a98f26-62, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84a98f26-62, col_values=(('qos', UUID('d0c52f25-1b42-47a1-8f80-57f33ebde9b2')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84a98f26-62, col_values=(('external_ids', {'iface-id': '84a98f26-6223-481f-9a63-c43d1488ee23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a5:f7', 'vm-uuid': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: INFO os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a5:f7,bridge_name='br-int',has_traffic_filtering=True,id=84a98f26-6223-481f-9a63-c43d1488ee23,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a98f26-62')
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=819f1bdc-383e-47b7-9838-254fd3a6f250,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819f1bdc-38') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=819f1bdc-383e-47b7-9838-254fd3a6f250,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819f1bdc-38') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e9a6003-3c0d-577e-a5ba-9d3ca692cc26', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap819f1bdc-38, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap819f1bdc-38, col_values=(('qos', UUID('871c5220-426a-46f2-89a0-6cb40e987265')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap819f1bdc-38, col_values=(('external_ids', {'iface-id': '819f1bdc-383e-47b7-9838-254fd3a6f250', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:2e:04', 'vm-uuid': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: INFO os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=819f1bdc-383e-47b7-9838-254fd3a6f250,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819f1bdc-38')
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:25,bridge_name='br-int',has_traffic_filtering=True,id=7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba68e0e-ea') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:25,bridge_name='br-int',has_traffic_filtering=True,id=7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba68e0e-ea') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bc79147-a534-5a29-b2a1-f379a1453768', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ba68e0e-ea, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ba68e0e-ea, col_values=(('qos', UUID('3e8a4ed3-f9f0-4889-8201-1674f044e873')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ba68e0e-ea, col_values=(('external_ids', {'iface-id': '7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:eb:25', 'vm-uuid': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: INFO os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:25,bridge_name='br-int',has_traffic_filtering=True,id=7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba68e0e-ea')
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f5:f5,bridge_name='br-int',has_traffic_filtering=True,id=a40baa56-0996-464c-a813-0bc924afa2fd,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40baa56-09') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f5:f5,bridge_name='br-int',has_traffic_filtering=True,id=a40baa56-0996-464c-a813-0bc924afa2fd,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40baa56-09') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8e806b5-83a2-5579-ae6c-31b7466e8db8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa40baa56-09, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa40baa56-09, col_values=(('qos', UUID('5ad8e2e7-a59c-4345-9836-d2c218d3cb2c')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa40baa56-09, col_values=(('external_ids', {'iface-id': 'a40baa56-0996-464c-a813-0bc924afa2fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:f5:f5', 'vm-uuid': '3fa124c3-9e3a-418f-bc95-6bce20b5e47d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:07:58 user nova-compute[75255]: INFO os_vif [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f5:f5,bridge_name='br-int',has_traffic_filtering=True,id=a40baa56-0996-464c-a813-0bc924afa2fd,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40baa56-09')
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] No BDM found with device name hda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] No VIF found with MAC fa:16:3e:11:91:b0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] No VIF found with MAC fa:16:3e:2e:2e:04, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:07:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Using config drive
Nov 14 11:07:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Creating config drive at /opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d/disk.config
Nov 14 11:07:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcwl7h73g {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:07:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcwl7h73g" returned: 0 in 0.075s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-65b6a718-81f5-49b7-b1d2-f51082a4787c req-ed95e1b6-de85-4a97-b51f-d5a41f3a35fc service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-65b6a718-81f5-49b7-b1d2-f51082a4787c req-ed95e1b6-de85-4a97-b51f-d5a41f3a35fc service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-65b6a718-81f5-49b7-b1d2-f51082a4787c req-ed95e1b6-de85-4a97-b51f-d5a41f3a35fc service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-65b6a718-81f5-49b7-b1d2-f51082a4787c req-ed95e1b6-de85-4a97-b51f-d5a41f3a35fc service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-65b6a718-81f5-49b7-b1d2-f51082a4787c req-ed95e1b6-de85-4a97-b51f-d5a41f3a35fc service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:00 user nova-compute[75255]: WARNING nova.compute.manager [req-65b6a718-81f5-49b7-b1d2-f51082a4787c req-ed95e1b6-de85-4a97-b51f-d5a41f3a35fc service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd for instance with vm_state building and task_state spawning.
Nov 14 11:08:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a65ace91-6ba4-481f-a59d-10e1b0a1be1a req-d9d8ba5e-d38d-4bef-9a3b-d37e587f78bf service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a65ace91-6ba4-481f-a59d-10e1b0a1be1a req-d9d8ba5e-d38d-4bef-9a3b-d37e587f78bf service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a65ace91-6ba4-481f-a59d-10e1b0a1be1a req-d9d8ba5e-d38d-4bef-9a3b-d37e587f78bf service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a65ace91-6ba4-481f-a59d-10e1b0a1be1a req-d9d8ba5e-d38d-4bef-9a3b-d37e587f78bf service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a65ace91-6ba4-481f-a59d-10e1b0a1be1a req-d9d8ba5e-d38d-4bef-9a3b-d37e587f78bf service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:01 user nova-compute[75255]: WARNING nova.compute.manager [req-a65ace91-6ba4-481f-a59d-10e1b0a1be1a req-d9d8ba5e-d38d-4bef-9a3b-d37e587f78bf service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 for instance with vm_state building and task_state spawning.
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-86780936-0127-44d3-baa9-7d161b94a330 req-65250cf2-a149-4a7a-a046-86253257ac54 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-86780936-0127-44d3-baa9-7d161b94a330 req-65250cf2-a149-4a7a-a046-86253257ac54 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-86780936-0127-44d3-baa9-7d161b94a330 req-65250cf2-a149-4a7a-a046-86253257ac54 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-86780936-0127-44d3-baa9-7d161b94a330 req-65250cf2-a149-4a7a-a046-86253257ac54 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-86780936-0127-44d3-baa9-7d161b94a330 req-65250cf2-a149-4a7a-a046-86253257ac54 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:02 user nova-compute[75255]: WARNING nova.compute.manager [req-86780936-0127-44d3-baa9-7d161b94a330 req-65250cf2-a149-4a7a-a046-86253257ac54 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd for instance with vm_state building and task_state spawning.
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:02 user nova-compute[75255]: WARNING nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd for instance with vm_state building and task_state spawning.
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:02 user nova-compute[75255]: WARNING nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 for instance with vm_state building and task_state spawning.
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:02 user nova-compute[75255]: WARNING nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 for instance with vm_state building and task_state spawning.
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:02 user nova-compute[75255]: WARNING nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 for instance with vm_state building and task_state spawning.
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:02 user nova-compute[75255]: WARNING nova.compute.manager [req-76669835-308e-42ba-97af-b92993a17700 req-32b80fbb-97bd-493c-8545-662200d404cd service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 for instance with vm_state building and task_state spawning.
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:03 user nova-compute[75255]: WARNING nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 for instance with vm_state building and task_state spawning.
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:03 user nova-compute[75255]: WARNING nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 for instance with vm_state building and task_state spawning.
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:03 user nova-compute[75255]: WARNING nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 for instance with vm_state building and task_state spawning.
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:03 user nova-compute[75255]: WARNING nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e for instance with vm_state building and task_state spawning.
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:03 user nova-compute[75255]: WARNING nova.compute.manager [req-8fdeb7e4-161c-4bff-bb20-a5bc1b1b65b0 req-0cf4c4f4-6c25-4ff1-be0a-6a086b763348 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e for instance with vm_state building and task_state spawning.
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:08:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance spawned successfully.
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c478ff5-1f64-4c9c-aa26-501072680513 req-5a0af412-7888-4f44-9a61-ee77357d986f service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c478ff5-1f64-4c9c-aa26-501072680513 req-5a0af412-7888-4f44-9a61-ee77357d986f service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c478ff5-1f64-4c9c-aa26-501072680513 req-5a0af412-7888-4f44-9a61-ee77357d986f service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c478ff5-1f64-4c9c-aa26-501072680513 req-5a0af412-7888-4f44-9a61-ee77357d986f service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c478ff5-1f64-4c9c-aa26-501072680513 req-5a0af412-7888-4f44-9a61-ee77357d986f service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:04 user nova-compute[75255]: WARNING nova.compute.manager [req-8c478ff5-1f64-4c9c-aa26-501072680513 req-5a0af412-7888-4f44-9a61-ee77357d986f service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd for instance with vm_state building and task_state spawning.
Nov 14 11:08:04 user nova-compute[75255]: INFO nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Took 10.89 seconds to spawn the instance on the hypervisor.
Nov 14 11:08:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:08:04 user nova-compute[75255]: INFO nova.compute.manager [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Took 30.63 seconds to build instance.
Nov 14 11:08:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cde3b415-e118-41b6-8d9c-84fd821a4e6c tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.751s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:15 user nova-compute[75255]: INFO nova.compute.manager [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Rescuing
Nov 14 11:08:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updating instance_info_cache with network_info: [{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-757d11aa-572a-4ab7-a5af-223d5de7050e req-ae1edb75-30f3-452f-96de-d80bc5fe41d3 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-unplugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-757d11aa-572a-4ab7-a5af-223d5de7050e req-ae1edb75-30f3-452f-96de-d80bc5fe41d3 service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-757d11aa-572a-4ab7-a5af-223d5de7050e req-ae1edb75-30f3-452f-96de-d80bc5fe41d3 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-757d11aa-572a-4ab7-a5af-223d5de7050e req-ae1edb75-30f3-452f-96de-d80bc5fe41d3 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-757d11aa-572a-4ab7-a5af-223d5de7050e req-ae1edb75-30f3-452f-96de-d80bc5fe41d3 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-unplugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:16 user nova-compute[75255]: WARNING nova.compute.manager [req-757d11aa-572a-4ab7-a5af-223d5de7050e req-ae1edb75-30f3-452f-96de-d80bc5fe41d3 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received unexpected event network-vif-unplugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with vm_state active and task_state rescuing.
Nov 14 11:08:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance destroyed successfully.
Nov 14 11:08:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Attempting rescue
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75255) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:08:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Creating image(s)
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.224s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue" returned: 0 in 0.045s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'migration_context' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.base [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<66031f17-4225-4c50-bd18-3df496586023> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Start _get_guest_xml network_info=[{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:da:f5:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'resources' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.base [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<66031f17-4225-4c50-bd18-3df496586023> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'numa_topology' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.base [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<66031f17-4225-4c50-bd18-3df496586023> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:08:17 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:08:17 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.base [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<66031f17-4225-4c50-bd18-3df496586023> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1506170198',display_name='tempest-ServerRescueNegativeTestJSON-server-1506170198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1506170198',id=2,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-wdlro802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:42Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=66031f17-4225-4c50-bd18-3df496586023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:da:f5:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:da:f5:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'pci_devices' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.objects.base [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<66031f17-4225-4c50-bd18-3df496586023> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:08:17 user nova-compute[75255]:   <uuid>66031f17-4225-4c50-bd18-3df496586023</uuid>
Nov 14 11:08:17 user nova-compute[75255]:   <name>instance-00000002</name>
Nov 14 11:08:17 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:08:17 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:08:17 user nova-compute[75255]:   <metadata>
Nov 14 11:08:17 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:08:17 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:08:17 user nova-compute[75255]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1506170198</nova:name>
Nov 14 11:08:17 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:08:17</nova:creationTime>
Nov 14 11:08:17 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:08:17 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:08:17 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:08:17 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:08:17 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:08:17 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:08:17 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:08:17 user nova-compute[75255]:       <nova:owner>
Nov 14 11:08:17 user nova-compute[75255]:         <nova:user uuid="13c7ed01376d41ac9b99ba698909e8bf">tempest-ServerRescueNegativeTestJSON-2135406154-project-member</nova:user>
Nov 14 11:08:17 user nova-compute[75255]:         <nova:project uuid="e4a3c374e68a4ec483ff0a15298b1bff">tempest-ServerRescueNegativeTestJSON-2135406154</nova:project>
Nov 14 11:08:17 user nova-compute[75255]:       </nova:owner>
Nov 14 11:08:17 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:08:17 user nova-compute[75255]:       <nova:ports>
Nov 14 11:08:17 user nova-compute[75255]:         <nova:port uuid="10813fe9-0bbf-4535-87ea-34769197f996">
Nov 14 11:08:17 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 11:08:17 user nova-compute[75255]:         </nova:port>
Nov 14 11:08:17 user nova-compute[75255]:       </nova:ports>
Nov 14 11:08:17 user nova-compute[75255]:     </nova:instance>
Nov 14 11:08:17 user nova-compute[75255]:   </metadata>
Nov 14 11:08:17 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:08:17 user nova-compute[75255]:     <system>
Nov 14 11:08:17 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:08:17 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:08:17 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:08:17 user nova-compute[75255]:       <entry name="serial">66031f17-4225-4c50-bd18-3df496586023</entry>
Nov 14 11:08:17 user nova-compute[75255]:       <entry name="uuid">66031f17-4225-4c50-bd18-3df496586023</entry>
Nov 14 11:08:17 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:08:17 user nova-compute[75255]:     </system>
Nov 14 11:08:17 user nova-compute[75255]:   </sysinfo>
Nov 14 11:08:17 user nova-compute[75255]:   <os>
Nov 14 11:08:17 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:08:17 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:08:17 user nova-compute[75255]:   </os>
Nov 14 11:08:17 user nova-compute[75255]:   <features>
Nov 14 11:08:17 user nova-compute[75255]:     <acpi/>
Nov 14 11:08:17 user nova-compute[75255]:     <apic/>
Nov 14 11:08:17 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:08:17 user nova-compute[75255]:   </features>
Nov 14 11:08:17 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:08:17 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:08:17 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:08:17 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:08:17 user nova-compute[75255]:   </clock>
Nov 14 11:08:17 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:08:17 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:08:17 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:08:17 user nova-compute[75255]:   </cpu>
Nov 14 11:08:17 user nova-compute[75255]:   <devices>
Nov 14 11:08:17 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:08:17 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:08:17 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue"/>
Nov 14 11:08:17 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:08:17 user nova-compute[75255]:     </disk>
Nov 14 11:08:17 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:08:17 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:08:17 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk"/>
Nov 14 11:08:17 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:08:17 user nova-compute[75255]:     </disk>
Nov 14 11:08:17 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:08:17 user nova-compute[75255]:       <mac address="fa:16:3e:da:f5:ff"/>
Nov 14 11:08:17 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:08:17 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:08:17 user nova-compute[75255]:       <target dev="tap10813fe9-0b"/>
Nov 14 11:08:17 user nova-compute[75255]:     </interface>
Nov 14 11:08:17 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:08:17 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/console.log" append="off"/>
Nov 14 11:08:17 user nova-compute[75255]:     </serial>
Nov 14 11:08:17 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:08:17 user nova-compute[75255]:     <video>
Nov 14 11:08:17 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:08:17 user nova-compute[75255]:     </video>
Nov 14 11:08:17 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:08:17 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:08:17 user nova-compute[75255]:     </rng>
Nov 14 11:08:17 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:08:17 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:08:17 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:08:17 user nova-compute[75255]:     </memballoon>
Nov 14 11:08:17 user nova-compute[75255]:   </devices>
Nov 14 11:08:17 user nova-compute[75255]: </domain>
Nov 14 11:08:17 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:08:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance destroyed successfully.
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No VIF found with MAC fa:16:3e:da:f5:ff, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-df0f41df-ab46-4070-8a7d-925a8d1a9243 req-4c41f824-b2ae-4d13-917b-23aeb0d4c37a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-df0f41df-ab46-4070-8a7d-925a8d1a9243 req-4c41f824-b2ae-4d13-917b-23aeb0d4c37a service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-df0f41df-ab46-4070-8a7d-925a8d1a9243 req-4c41f824-b2ae-4d13-917b-23aeb0d4c37a service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-df0f41df-ab46-4070-8a7d-925a8d1a9243 req-4c41f824-b2ae-4d13-917b-23aeb0d4c37a service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-df0f41df-ab46-4070-8a7d-925a8d1a9243 req-4c41f824-b2ae-4d13-917b-23aeb0d4c37a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:18 user nova-compute[75255]: WARNING nova.compute.manager [req-df0f41df-ab46-4070-8a7d-925a8d1a9243 req-4c41f824-b2ae-4d13-917b-23aeb0d4c37a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received unexpected event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with vm_state active and task_state rescuing.
Nov 14 11:08:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:21 user nova-compute[75255]: WARNING nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received unexpected event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with vm_state active and task_state rescuing.
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:21 user nova-compute[75255]: WARNING nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received unexpected event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with vm_state active and task_state rescuing.
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-changed-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Refreshing instance network info cache due to event network-changed-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.network.neutron [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Refreshing network info cache for port 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5d2a6035-356e-488f-a06d-c7816385ee8e tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.network.neutron [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updated VIF entry in instance network info cache for port 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG nova.network.neutron [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d5ea9ad3-49fc-418a-a855-d557f1d639ff req-36ae81be-71e0-4600-9aaa-18e3b894ed3a service nova] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-changed-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Refreshing instance network info cache due to event network-changed-a7b74d75-61f6-40f3-bd68-04c50de0c3b3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] Acquiring lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] Acquired lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Refreshing network info cache for port a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updated VIF entry in instance network info cache for port a7b74d75-61f6-40f3-bd68-04c50de0c3b3. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updating instance_info_cache with network_info: [{"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8bcdeeb0-bdad-4f56-bce0-40cf614403b2 req-14ba566f-0571-4bcc-8dbc-2802368d1cf9 service nova] Releasing lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:28 user nova-compute[75255]: INFO nova.compute.manager [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Attaching volume 2951755d-901c-4201-807e-ccf0536a2981 to /dev/vdb
Nov 14 11:08:28 user nova-compute[75255]: DEBUG os_brick.utils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1a8899-f06a-4448-ae7f-fe690d319fca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcb38b7-524d-49c4-8c1c-91ab061a6110]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17afe40-380a-4917-b35c-7f32fdf1bae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4bb3b9-25a0-4415-9934-c13de1b37d4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:28 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b178c52-7481-447f-b129-c87f434162ad]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG os_brick.utils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updating existing volume attachment record: 231b578a-f475-48f8-a7ff-4d7a1c9adf88 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:08:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:30 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:08:30 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=25.333839416503906GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2e186944-c41d-4f07-b852-ff17b2241241 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2ce264fc-cc38-421a-92ae-41dc6174745d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 722f579b-576b-4154-b380-7fc78dc7b9b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d7f63547-b356-471b-825d-6a0b4670221d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 41aa15c1-08df-4bc5-907c-36790452a8af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3fa124c3-9e3a-418f-bc95-6bce20b5e47d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:08:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxBhFUsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:32 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:32 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:32 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c242759-e978-49ad-a84e-174c09b5a0c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:08:32 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6050513-7aed-4e1b-b290-042d874eb731]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981] added
Nov 14 11:08:32 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f819f9-8382-44f5-905d-392d0420204e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dbaf85-b14c-437d-bb6e-4fa681b5037e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IxBhFUsT {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IxBhFUsT" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0179a3e-8f6f-4724-8d92-c4665ab449d3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IxBhFUsT'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c63e15-824b-4b51-8020-51970c1a386b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7cf729-d8d6-4e22-bd26-e60b09de48df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:32 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:32 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1641e6ae-6ca3-4935-91cd-c12f0f2d2c20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260]
Nov 14 11:08:32 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260] successful.
Nov 14 11:08:32 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26cafd4-3ee3-4e60-b46b-9dfcb5d67ef5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a828a274-fb03-4d6a-aaaf-07572a6308e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:32 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:32 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:32 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:08:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b4fe3-2ead-4d39-90b3-750847e1ebe2]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxBhFUsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updating instance_info_cache with network_info: [{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26236333335653338', 'path': '/dev/sde'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236333335653338', 'path': '/dev/sde'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:08:34 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:08:34 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:08:34 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:08:34 user nova-compute[75255]:   <serial>2951755d-901c-4201-807e-ccf0536a2981</serial>
Nov 14 11:08:34 user nova-compute[75255]: </disk>
Nov 14 11:08:34 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No VIF found with MAC fa:16:3e:87:f3:6b, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-changed-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Refreshing instance network info cache due to event network-changed-835970ab-7fbc-40e7-aa3d-7301d32d936e. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] Acquiring lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] Acquired lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Refreshing network info cache for port 835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7b67c36b-f488-48b0-8f43-52728d73fa52 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.381s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updated VIF entry in instance network info cache for port 835970ab-7fbc-40e7-aa3d-7301d32d936e. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updating instance_info_cache with network_info: [{"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-99b7ff27-5eaa-42a6-8214-a0977596f435 req-eba00f6a-c925-4383-aaa9-650055257b38 service nova] Releasing lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lazy-loading 'flavor' on Instance uuid 2e186944-c41d-4f07-b852-ff17b2241241 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:36 user nova-compute[75255]: INFO nova.compute.manager [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Attaching volume b8d33fa0-7605-4d36-a523-736eb4f4e451 to /dev/vdb
Nov 14 11:08:36 user nova-compute[75255]: DEBUG os_brick.utils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193ca62-dd56-43c0-91f2-a2086dab1142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadda2a6-d1a7-4aa8-b19b-ead2126337a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca886f-4f50-402d-b61f-d6bf76243c77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98274d5-c8c6-45ab-bf5d-97a3d7f04183]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:36 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:08:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebac0ab-506c-4cf2-b3ca-1e9d060dbb0c]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG os_brick.utils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:36 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updating existing volume attachment record: db33a5bd-8ed4-427a-9e73-15016f32f83c {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:08:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:08:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:08:37 user nova-compute[75255]: INFO nova.compute.claims [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Claim successful on node user
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:08:38 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.policy [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501c5fe846ca4bfeacc413c97911f8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524a841af9524bd98f64657594598808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:08:38 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Creating image(s)
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk 1073741824" returned: 0 in 0.057s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.165s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Successfully created port: da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Cannot resize image /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Successfully updated port: da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquired lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-changed-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Refreshing instance network info cache due to event network-changed-da25fbae-506b-47a6-8de0-5325d33d4786. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] Acquiring lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Updating instance_info_cache with network_info: [{"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Releasing lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Instance network_info: |[{"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] Acquired lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.neutron [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Refreshing network info cache for port da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Start _get_guest_xml network_info=[{"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:08:40 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:08:40 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2096020659',display_name='tempest-AttachVolumeNegativeTest-server-2096020659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2096020659',id=13,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3E5deyMQNOcoC9KTBBPamCfYZA4ChfP1pGUriXtUqSekQQ5/MKSwdTW1YFHuJA2OZmtMuCCMyLwl+qmvvxdaAvXHn4qRwYmwKeANgBkcmBM+0dY8lzN1uxZyIrPW87rA==',key_name='tempest-keypair-543350306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-4t84mirh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=3d6a0be5-ad0d-4099-bacf-50c5bd2e521c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:22,bridge_name='br-int',has_traffic_filtering=True,id=da25fbae-506b-47a6-8de0-5325d33d4786,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda25fbae-50') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.objects.instance [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:08:40 user nova-compute[75255]:   <uuid>3d6a0be5-ad0d-4099-bacf-50c5bd2e521c</uuid>
Nov 14 11:08:40 user nova-compute[75255]:   <name>instance-0000000d</name>
Nov 14 11:08:40 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:08:40 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:08:40 user nova-compute[75255]:   <metadata>
Nov 14 11:08:40 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:08:40 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:08:40 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2096020659</nova:name>
Nov 14 11:08:40 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:08:40</nova:creationTime>
Nov 14 11:08:40 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:08:40 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:08:40 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:08:40 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:08:40 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:08:40 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:08:40 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:08:40 user nova-compute[75255]:       <nova:owner>
Nov 14 11:08:40 user nova-compute[75255]:         <nova:user uuid="501c5fe846ca4bfeacc413c97911f8f6">tempest-AttachVolumeNegativeTest-1930109654-project-member</nova:user>
Nov 14 11:08:40 user nova-compute[75255]:         <nova:project uuid="524a841af9524bd98f64657594598808">tempest-AttachVolumeNegativeTest-1930109654</nova:project>
Nov 14 11:08:40 user nova-compute[75255]:       </nova:owner>
Nov 14 11:08:40 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:08:40 user nova-compute[75255]:       <nova:ports>
Nov 14 11:08:40 user nova-compute[75255]:         <nova:port uuid="da25fbae-506b-47a6-8de0-5325d33d4786">
Nov 14 11:08:40 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:08:40 user nova-compute[75255]:         </nova:port>
Nov 14 11:08:40 user nova-compute[75255]:       </nova:ports>
Nov 14 11:08:40 user nova-compute[75255]:     </nova:instance>
Nov 14 11:08:40 user nova-compute[75255]:   </metadata>
Nov 14 11:08:40 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:08:40 user nova-compute[75255]:     <system>
Nov 14 11:08:40 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:08:40 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:08:40 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:08:40 user nova-compute[75255]:       <entry name="serial">3d6a0be5-ad0d-4099-bacf-50c5bd2e521c</entry>
Nov 14 11:08:40 user nova-compute[75255]:       <entry name="uuid">3d6a0be5-ad0d-4099-bacf-50c5bd2e521c</entry>
Nov 14 11:08:40 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:08:40 user nova-compute[75255]:     </system>
Nov 14 11:08:40 user nova-compute[75255]:   </sysinfo>
Nov 14 11:08:40 user nova-compute[75255]:   <os>
Nov 14 11:08:40 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:08:40 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:08:40 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:08:40 user nova-compute[75255]:   </os>
Nov 14 11:08:40 user nova-compute[75255]:   <features>
Nov 14 11:08:40 user nova-compute[75255]:     <acpi/>
Nov 14 11:08:40 user nova-compute[75255]:     <apic/>
Nov 14 11:08:40 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:08:40 user nova-compute[75255]:   </features>
Nov 14 11:08:40 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:08:40 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:08:40 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:08:40 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:08:40 user nova-compute[75255]:   </clock>
Nov 14 11:08:40 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:08:40 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:08:40 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:08:40 user nova-compute[75255]:   </cpu>
Nov 14 11:08:40 user nova-compute[75255]:   <devices>
Nov 14 11:08:40 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:08:40 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:08:40 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk"/>
Nov 14 11:08:40 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:08:40 user nova-compute[75255]:     </disk>
Nov 14 11:08:40 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:08:40 user nova-compute[75255]:       <mac address="fa:16:3e:ec:26:22"/>
Nov 14 11:08:40 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:08:40 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:08:40 user nova-compute[75255]:       <target dev="tapda25fbae-50"/>
Nov 14 11:08:40 user nova-compute[75255]:     </interface>
Nov 14 11:08:40 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:08:40 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/console.log" append="off"/>
Nov 14 11:08:40 user nova-compute[75255]:     </serial>
Nov 14 11:08:40 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:08:40 user nova-compute[75255]:     <video>
Nov 14 11:08:40 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:08:40 user nova-compute[75255]:     </video>
Nov 14 11:08:40 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:08:40 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:08:40 user nova-compute[75255]:     </rng>
Nov 14 11:08:40 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:08:40 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:08:40 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:08:40 user nova-compute[75255]:     </memballoon>
Nov 14 11:08:40 user nova-compute[75255]:   </devices>
Nov 14 11:08:40 user nova-compute[75255]: </domain>
Nov 14 11:08:40 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2096020659',display_name='tempest-AttachVolumeNegativeTest-server-2096020659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2096020659',id=13,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3E5deyMQNOcoC9KTBBPamCfYZA4ChfP1pGUriXtUqSekQQ5/MKSwdTW1YFHuJA2OZmtMuCCMyLwl+qmvvxdaAvXHn4qRwYmwKeANgBkcmBM+0dY8lzN1uxZyIrPW87rA==',key_name='tempest-keypair-543350306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-4t84mirh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=3d6a0be5-ad0d-4099-bacf-50c5bd2e521c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:22,bridge_name='br-int',has_traffic_filtering=True,id=da25fbae-506b-47a6-8de0-5325d33d4786,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda25fbae-50') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG os_vif [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:22,bridge_name='br-int',has_traffic_filtering=True,id=da25fbae-506b-47a6-8de0-5325d33d4786,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda25fbae-50') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29bfc175-790f-513a-851b-4b99da21142b', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda25fbae-50, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda25fbae-50, col_values=(('qos', UUID('d9f84b28-0058-4376-a247-1d3118ebba45')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda25fbae-50, col_values=(('external_ids', {'iface-id': 'da25fbae-506b-47a6-8de0-5325d33d4786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:26:22', 'vm-uuid': '3d6a0be5-ad0d-4099-bacf-50c5bd2e521c'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:40 user nova-compute[75255]: INFO os_vif [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:22,bridge_name='br-int',has_traffic_filtering=True,id=da25fbae-506b-47a6-8de0-5325d33d4786,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda25fbae-50')
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No VIF found with MAC fa:16:3e:ec:26:22, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.neutron [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Updated VIF entry in instance network info cache for port da25fbae-506b-47a6-8de0-5325d33d4786. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG nova.network.neutron [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Updating instance_info_cache with network_info: [{"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4ead0205-2c4d-4240-8242-2bf8800f08d0 req-3fda1d6b-4f1f-4bbb-ba4f-3ce417ce0319 service nova] Releasing lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDvGweUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:41 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:41 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:41 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec12ce1-aef3-4482-9f2d-fdf36344a6fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:08:41 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396dd07-de30-4a8e-bf78-7005811af400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451] added
Nov 14 11:08:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f87e0-dfc2-43de-b423-65b47d6929be]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[48494b13-3bea-4639-9098-ea62d0e691ee]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDvGweUc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDvGweUc" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ac4f98-9cdf-4f8e-afa6-0a6b5450e027]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDvGweUc'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[853badbc-e3f8-4342-abd1-e21a202d1f26]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae7432-6a79-486b-a51a-4bfbccf68182]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea3244-cc02-4e91-bc16-261064bbe477]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260]
Nov 14 11:08:41 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260] successful.
Nov 14 11:08:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[af505ee0-3b1c-4f0a-923e-05da7f5b0dd4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e784ac5-76a5-4722-898d-f44002a9db05]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[addb615a-3747-40ab-b406-fe3e14e4441c]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDvGweUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-changed-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Refreshing instance network info cache due to event network-changed-6deed208-a0e2-42d2-9f6d-60ca090458bb. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] Acquiring lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] Acquired lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG nova.network.neutron [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Refreshing network info cache for port 6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-6c65d8a9-79e1-43a7-a926-27a35882b752 req-d49e9720-4e27-4c0a-84a8-3494413af972 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6c65d8a9-79e1-43a7-a926-27a35882b752 req-d49e9720-4e27-4c0a-84a8-3494413af972 service nova] Acquiring lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6c65d8a9-79e1-43a7-a926-27a35882b752 req-d49e9720-4e27-4c0a-84a8-3494413af972 service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6c65d8a9-79e1-43a7-a926-27a35882b752 req-d49e9720-4e27-4c0a-84a8-3494413af972 service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-6c65d8a9-79e1-43a7-a926-27a35882b752 req-d49e9720-4e27-4c0a-84a8-3494413af972 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] No waiting events found dispatching network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:41 user nova-compute[75255]: WARNING nova.compute.manager [req-6c65d8a9-79e1-43a7-a926-27a35882b752 req-d49e9720-4e27-4c0a-84a8-3494413af972 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received unexpected event network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 for instance with vm_state building and task_state spawning.
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lazy-loading 'flavor' on Instance uuid 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG nova.network.neutron [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Updated VIF entry in instance network info cache for port 6deed208-a0e2-42d2-9f6d-60ca090458bb. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG nova.network.neutron [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Updating instance_info_cache with network_info: [{"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:42 user nova-compute[75255]: INFO nova.compute.manager [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Attaching volume e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 to /dev/vdb
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bbf70d89-d642-4c0c-bd27-e9c46ec4e12a req-a0fb0cf2-fff0-44ff-8395-6a3044095d9c service nova] Releasing lock "refresh_cache-2ce264fc-cc38-421a-92ae-41dc6174745d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.utils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef3774-228e-4b4d-b055-bf8a24605efd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b865237-9b5c-45e5-a2c5-38d79a21ab52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f7dad1-65c9-4c7b-9d1d-5f0900303fe9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3ed1e9-4650-4a3f-a10d-998a64535897]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:42 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:08:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f65788a-f2bb-48e1-9a14-ccd0509f2126]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.utils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Updating existing volume attachment record: 8c628908-79d6-42ad-8a16-f4e4a72918ee {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26265643539323135', 'path': '/dev/sdf'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265643539323135', 'path': '/dev/sdf'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lazy-loading 'flavor' on Instance uuid 2e186944-c41d-4f07-b852-ff17b2241241 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:08:42 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:08:42 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:08:42 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:08:42 user nova-compute[75255]:   <serial>b8d33fa0-7605-4d36-a523-736eb4f4e451</serial>
Nov 14 11:08:42 user nova-compute[75255]: </disk>
Nov 14 11:08:42 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] No VIF found with MAC fa:16:3e:6c:b1:bc, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6159031f-5e9a-4670-bb58-f6402b2f9c50 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.065s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-33374d91-20c6-4ade-acc5-5958c016e8db req-e7420ed9-6560-46aa-a622-5c4fdc472538 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-33374d91-20c6-4ade-acc5-5958c016e8db req-e7420ed9-6560-46aa-a622-5c4fdc472538 service nova] Acquiring lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-33374d91-20c6-4ade-acc5-5958c016e8db req-e7420ed9-6560-46aa-a622-5c4fdc472538 service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-33374d91-20c6-4ade-acc5-5958c016e8db req-e7420ed9-6560-46aa-a622-5c4fdc472538 service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-33374d91-20c6-4ade-acc5-5958c016e8db req-e7420ed9-6560-46aa-a622-5c4fdc472538 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] No waiting events found dispatching network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:43 user nova-compute[75255]: WARNING nova.compute.manager [req-33374d91-20c6-4ade-acc5-5958c016e8db req-e7420ed9-6560-46aa-a622-5c4fdc472538 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received unexpected event network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 for instance with vm_state building and task_state spawning.
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:08:43 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Instance spawned successfully.
Nov 14 11:08:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:08:44 user nova-compute[75255]: INFO nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:08:44 user nova-compute[75255]: INFO nova.compute.manager [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Took 6.77 seconds to build instance.
Nov 14 11:08:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd2b2e2a-474d-40c0-8898-53ebd0056f5f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.874s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:44 user nova-compute[75255]: INFO nova.compute.manager [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Detaching volume b8d33fa0-7605-4d36-a523-736eb4f4e451
Nov 14 11:08:44 user nova-compute[75255]: INFO nova.virt.block_device [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Attempting to driver detach volume b8d33fa0-7605-4d36-a523-736eb4f4e451 from mountpoint /dev/vdb
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Attempting to detach device vdb from instance 2e186944-c41d-4f07-b852-ff17b2241241 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:08:44 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:08:44 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:08:44 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:08:44 user nova-compute[75255]:   <serial>b8d33fa0-7605-4d36-a523-736eb4f4e451</serial>
Nov 14 11:08:44 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:08:44 user nova-compute[75255]: </disk>
Nov 14 11:08:44 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:08:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Successfully detached device vdb from instance 2e186944-c41d-4f07-b852-ff17b2241241 from the persistent domain config.
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e186944-c41d-4f07-b852-ff17b2241241 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:08:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:08:44 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:08:44 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:08:44 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:08:44 user nova-compute[75255]:   <serial>b8d33fa0-7605-4d36-a523-736eb4f4e451</serial>
Nov 14 11:08:44 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:08:44 user nova-compute[75255]: </disk>
Nov 14 11:08:44 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:08:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e186944-c41d-4f07-b852-ff17b2241241 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:46 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:46 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:46 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0cf273-815d-4fca-97d4-7a7a55ce2ee6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:08:46 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bbe0a3-ee05-410e-8e9b-e7005d5e8de0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0] added
Nov 14 11:08:46 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cbb765-3c8d-42f1-98b6-9e4af7f2df85]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6fb353-6145-42bc-8216-8fe6ce847cd9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzKIRtTN {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzKIRtTN" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7cd1ec-b0ee-4ccb-9073-8eb0dfa34c9c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JzKIRtTN'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[975be05f-095e-4597-8fd3-df1297ccf955]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24274c1-0c58-4063-895a-77c015831eff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:46 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:46 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:46 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d4ed89-b5f0-45f3-895d-22785d03dbe8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]
Nov 14 11:08:46 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.
Nov 14 11:08:46 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef5562f-1373-484b-aec7-b72565fad01f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cb1f20-3cc9-48db-b252-18683adde086]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:08:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baa7fce-8606-4ef1-80f7-ebe84871f350]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:08:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23030396331323132', 'path': '/dev/sdg'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030396331323132', 'path': '/dev/sdg'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lazy-loading 'flavor' on Instance uuid 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:08:48 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:08:48 user nova-compute[75255]:   <source dev="/dev/sdg"/>
Nov 14 11:08:48 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:08:48 user nova-compute[75255]:   <serial>e0b7daf7-cdf6-4914-85fa-c38cd09c01a0</serial>
Nov 14 11:08:48 user nova-compute[75255]: </disk>
Nov 14 11:08:48 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] No VIF found with MAC fa:16:3e:2f:e3:61, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:08:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6be5664d-8a66-485e-ab72-5d30cb34c979 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.553s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG os_brick.utils [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33b84bb-e23d-478d-ad36-ecf079b19816]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd89ed2-baaf-4fdf-91be-82fd5930b415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c51b7-8e59-468e-823f-3dba81e54329]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c408b1-3197-46cd-8b1a-0022c0c43aea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:50 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:08:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75a12f5-7976-4e5c-8575-ef2bab18f05b]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:08:50 user nova-compute[75255]: DEBUG os_brick.utils [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:50 user nova-compute[75255]: INFO nova.compute.manager [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Swapping volume e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 for e226eff9-7c70-42d2-8d08-56826778effe
Nov 14 11:08:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-changed-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Refreshing instance network info cache due to event network-changed-062e8b6c-1f14-4ae5-af6d-f7479c26ad46. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] Acquiring lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] Acquired lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Refreshing network info cache for port 062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Updated VIF entry in instance network info cache for port 062e8b6c-1f14-4ae5-af6d-f7479c26ad46. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Updating instance_info_cache with network_info: [{"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fca3c61d-220b-4bc2-99d3-4ffb5b62e359 req-7da258bb-9cd1-4ad1-9be6-e8965ed98ea0 service nova] Releasing lock "refresh_cache-722f579b-576b-4154-b380-7fc78dc7b9b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lazy-loading 'flavor' on Instance uuid 722f579b-576b-4154-b380-7fc78dc7b9b9 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:54 user nova-compute[75255]: INFO nova.compute.manager [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Attaching volume 3a53b75a-1962-4a0b-b9e7-803c8beab75b to /dev/sdc
Nov 14 11:08:54 user nova-compute[75255]: DEBUG os_brick.utils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea8605a-24da-4fe2-ace9-a7d55d7dbb45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f00d42-6ada-410c-adb7-bc752d0c5472]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef24994f-344f-42e3-8ed2-ab09f9410a57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[87980693-ad79-413a-b695-67c4144ca311]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:08:54 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:08:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f358a0-0d54-4e1c-8468-ba79d33cedd6]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG os_brick.utils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:08:54 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Updating existing volume attachment record: 141ba1cb-6cd3-43f4-98f3-12e88c351f24 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:08:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-changed-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Refreshing instance network info cache due to event network-changed-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] Acquiring lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] Acquired lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Refreshing network info cache for port 7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "interface-d7f63547-b356-471b-825d-6a0b4670221d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "interface-d7f63547-b356-471b-825d-6a0b4670221d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'flavor' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updated VIF entry in instance network info cache for port 7e5074e8-0f3b-4d4e-886d-b667c9ec37c9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2f83fa4b-5e55-470c-932f-97fb8357d70a req-97716c5d-716d-4d10-93cc-b20375418443 service nova] Releasing lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'pci_requests' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.objects.base [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Object Instance<d7f63547-b356-471b-825d-6a0b4670221d> lazy-loaded attributes: flavor,pci_requests {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.network.neutron [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:08:57 user nova-compute[75255]: DEBUG nova.policy [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '131d5867bb7f4f3bad0889df1d1f52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d728ce7e654140995d4ab0e3c81b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:08:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Successfully created port: 7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:08:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Successfully updated port: 7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:08:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquired lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-changed-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Refreshing instance network info cache due to event network-changed-7163a946-368a-49f4-b31b-d318ec43eb76. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] Acquiring lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.neutron [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Releasing lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] Acquired lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.neutron [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Refreshing network info cache for port 7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converting VIF {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_vif [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cebc4085-9de9-5010-97b8-ba3b88dc7d0a', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7163a946-36, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7163a946-36, col_values=(('qos', UUID('6b537b67-c05f-4e5e-a281-a55b70f283ef')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7163a946-36, col_values=(('external_ids', {'iface-id': '7163a946-368a-49f4-b31b-d318ec43eb76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:f8:c7', 'vm-uuid': 'd7f63547-b356-471b-825d-6a0b4670221d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: INFO os_vif [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36')
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converting VIF {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] attach device xml: <interface type="ethernet">
Nov 14 11:08:59 user nova-compute[75255]:   <mac address="fa:16:3e:74:f8:c7"/>
Nov 14 11:08:59 user nova-compute[75255]:   <model type="virtio"/>
Nov 14 11:08:59 user nova-compute[75255]:   <mtu size="1442"/>
Nov 14 11:08:59 user nova-compute[75255]:   <target dev="tap7163a946-36"/>
Nov 14 11:08:59 user nova-compute[75255]: </interface>
Nov 14 11:08:59 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.neutron [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updated VIF entry in instance network info cache for port 7163a946-368a-49f4-b31b-d318ec43eb76. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.network.neutron [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8686fbe4-bf0a-4b64-86cd-9bce2e294175 req-d0d4ae14-e553-415c-a324-4a2e92dc8306 service nova] Releasing lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-e973b883-799e-4bc5-841b-ade39caf2842 req-aebcb4f1-502f-4361-aeba-8c48f3216556 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e973b883-799e-4bc5-841b-ade39caf2842 req-aebcb4f1-502f-4361-aeba-8c48f3216556 service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e973b883-799e-4bc5-841b-ade39caf2842 req-aebcb4f1-502f-4361-aeba-8c48f3216556 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e973b883-799e-4bc5-841b-ade39caf2842 req-aebcb4f1-502f-4361-aeba-8c48f3216556 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-e973b883-799e-4bc5-841b-ade39caf2842 req-aebcb4f1-502f-4361-aeba-8c48f3216556 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:08:59 user nova-compute[75255]: WARNING nova.compute.manager [req-e973b883-799e-4bc5-841b-ade39caf2842 req-aebcb4f1-502f-4361-aeba-8c48f3216556 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received unexpected event network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 for instance with vm_state active and task_state None.
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GonDfeHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ce264fc-cc38-421a-92ae-41dc6174745d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e226eff9-7c70-42d2-8d08-56826778effe', 'serial': 'e226eff9-7c70-42d2-8d08-56826778effe'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '2ce264fc-cc38-421a-92ae-41dc6174745d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'serial'} {{(pid=75255) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GonDfeHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:59 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:59 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:08:59 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No BDM found with device name hda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No VIF found with MAC fa:16:3e:ab:be:4a, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[707aaf2d-e87a-4600-9c38-c11e3f5c9f0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:08:59 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae05406a-b031-4294-b18a-b7fcd70feb48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe] added
Nov 14 11:08:59 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:08:59 user nova-compute[75255]:   <nova:package version="0.0.0"/>
Nov 14 11:08:59 user nova-compute[75255]:   <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:08:59 user nova-compute[75255]:   <nova:creationTime>2023-11-14 11:08:59</nova:creationTime>
Nov 14 11:08:59 user nova-compute[75255]:   <nova:flavor name="m1.tiny">
Nov 14 11:08:59 user nova-compute[75255]:     <nova:memory>512</nova:memory>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:disk>1</nova:disk>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:swap>0</nova:swap>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:vcpus>1</nova:vcpus>
Nov 14 11:08:59 user nova-compute[75255]:   </nova:flavor>
Nov 14 11:08:59 user nova-compute[75255]:   <nova:owner>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:08:59 user nova-compute[75255]:   </nova:owner>
Nov 14 11:08:59 user nova-compute[75255]:   <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:08:59 user nova-compute[75255]:   <nova:ports>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:08:59 user nova-compute[75255]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:08:59 user nova-compute[75255]:     </nova:port>
Nov 14 11:08:59 user nova-compute[75255]:     <nova:port uuid="7163a946-368a-49f4-b31b-d318ec43eb76">
Nov 14 11:08:59 user nova-compute[75255]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 14 11:08:59 user nova-compute[75255]:     </nova:port>
Nov 14 11:08:59 user nova-compute[75255]:   </nova:ports>
Nov 14 11:08:59 user nova-compute[75255]: </nova:instance>
Nov 14 11:08:59 user nova-compute[75255]:  {{(pid=75255) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgAUTEpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:08:59 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3b3fb-aac5-4c1b-bdda-f5c8f6bfcb20]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b72f86-8167-4ae5-b207-a1e70856abd9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GonDfeHS {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-246ac912-1a9f-4bcb-a03a-5a4294bda148 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "interface-d7f63547-b356-471b-825d-6a0b4670221d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.459s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GonDfeHS" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0896a5d6-219a-44df-9cf1-51a05c6eb30f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GonDfeHS'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c92649-8439-49dd-a109-ad7ab8289948]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f50be-fd30-446d-bdb5-1e79dac4d4fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:08:59 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:08:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b4027-85db-4d58-962f-a499e7ca6b6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260]
Nov 14 11:09:00 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:00 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa096d8-dded-46af-930f-e0a4573f02a4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[382d621b-c689-417f-a452-96f1c5669ed4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:00 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:00 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:00 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a27b61-9ee5-4be6-b037-9d5f5db3ab2e]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG nova.objects.instance [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'flavor' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:00 user nova-compute[75255]: INFO nova.compute.manager [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Attaching volume 3036f762-c0ed-48c7-9744-509321c19847 to /dev/vdb
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.utils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[58369225-0548-4da4-bcb4-efef15e08f59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9b01c-5d92-4dc7-be8d-75bf577a618f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47546d6-52a5-4422-a0f4-8667ad252ca3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf143368-d230-4d15-a25b-f0b509f53103]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:00 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:09:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4207a15-fb1b-4361-9241-ac224f8ba2ae]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG os_brick.utils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:00 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating existing volume attachment record: e0f2978d-c62e-41aa-9cf9-abd8c57a64e1 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GonDfeHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26562326434616130', 'path': '/dev/sdh'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562326434616130', 'path': '/dev/sdh'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.312s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:01 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:01 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lazy-loading 'flavor' on Instance uuid 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad5cd6-3adf-4d2b-addf-05b1c7428bf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:09:01 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aa07d6-afdc-48dd-9fa7-447f860374c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b] added
Nov 14 11:09:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4db5e5-833b-437b-a5b7-ac3d145c2392]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=75255) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 11:09:01 user nova-compute[75255]: INFO nova.virt.libvirt.host [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] UEFI support detected
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a44c892-5cba-4c61-a716-2642162d99ba]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgAUTEpq {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgAUTEpq" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e613588-355b-4a73-84f1-0e51be6b57bd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgAUTEpq'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16cd9f5-7f19-43e8-bf6f-9cce494d0756]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[831b295d-1646-47ae-a5fd-c7fdc00ee79d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ba0bb0-5371-4a42-a1e8-8cccf677ff34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260]
Nov 14 11:09:01 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58c185f-6596-4d39-81ff-3b138e3bdce6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3798a618-e0f8-4f56-8438-bf72868e9a6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:01 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd26f30-23a7-4022-b730-54988f6431b9]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgAUTEpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-changed-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Refreshing instance network info cache due to event network-changed-438aabcf-8c82-4604-a29b-fa5d012b879d. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] Acquiring lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] Acquired lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Refreshing network info cache for port 438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-b91b2607-c9f1-4a9e-b049-717aa2dabcc1 req-97c10605-3658-4323-accd-10e9f8a2d822 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b91b2607-c9f1-4a9e-b049-717aa2dabcc1 req-97c10605-3658-4323-accd-10e9f8a2d822 service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b91b2607-c9f1-4a9e-b049-717aa2dabcc1 req-97c10605-3658-4323-accd-10e9f8a2d822 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b91b2607-c9f1-4a9e-b049-717aa2dabcc1 req-97c10605-3658-4323-accd-10e9f8a2d822 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-b91b2607-c9f1-4a9e-b049-717aa2dabcc1 req-97c10605-3658-4323-accd-10e9f8a2d822 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:01 user nova-compute[75255]: WARNING nova.compute.manager [req-b91b2607-c9f1-4a9e-b049-717aa2dabcc1 req-97c10605-3658-4323-accd-10e9f8a2d822 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received unexpected event network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 for instance with vm_state active and task_state None.
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lazy-loading 'flavor' on Instance uuid 41aa15c1-08df-4bc5-907c-36790452a8af {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:02 user nova-compute[75255]: INFO nova.compute.manager [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Attaching volume c286590e-49af-4da4-9413-207fff648d1d to /dev/vdb
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Updated VIF entry in instance network info cache for port 438aabcf-8c82-4604-a29b-fa5d012b879d. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Updating instance_info_cache with network_info: [{"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a107ec64-ebf0-45ac-b119-b3a8ecef7da3 req-9bad85a4-fc25-4380-a66f-569927899b90 service nova] Releasing lock "refresh_cache-41aa15c1-08df-4bc5-907c-36790452a8af" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.utils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e78eb-e9b2-4f6e-8f93-d0d9ef919e09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c579fb1-dc52-49d3-8f6b-cfb41e20ce0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1887a0d-b144-49f6-a63c-344b2be154ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a9fd0-cfe7-4005-a06c-c75986632b4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:02 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:09:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe2d44c-05e3-4955-a1ff-b9fdf309768b]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.utils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Updating existing volume attachment record: 42eccbc9-56d1-4e44-bf5d-3f3faa3d2e3a {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] <== connect_volume: return (2690ms) {'type': 'block', 'scsi_wwn': '23863333534393931', 'path': '/dev/sdi'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863333534393931', 'path': '/dev/sdi'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lazy-loading 'flavor' on Instance uuid 722f579b-576b-4154-b380-7fc78dc7b9b9 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:09:02 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:02 user nova-compute[75255]:   <source dev="/dev/sdi"/>
Nov 14 11:09:02 user nova-compute[75255]:   <target dev="sdc" bus="scsi"/>
Nov 14 11:09:02 user nova-compute[75255]:   <serial>3a53b75a-1962-4a0b-b9e7-803c8beab75b</serial>
Nov 14 11:09:02 user nova-compute[75255]:   <address type="drive" controller="0" unit="2"/>
Nov 14 11:09:02 user nova-compute[75255]: </disk>
Nov 14 11:09:02 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:09:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 335544320 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] No BDM found with device name sda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] No VIF found with MAC fa:16:3e:45:87:1d, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 479199232 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5563864a-1014-4db5-ba3e-adec09887e7e tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.024s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 776994816 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:04 user nova-compute[75255]: INFO nova.compute.manager [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Detaching volume 3a53b75a-1962-4a0b-b9e7-803c8beab75b
Nov 14 11:09:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:04 user nova-compute[75255]: INFO nova.virt.block_device [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Attempting to driver detach volume 3a53b75a-1962-4a0b-b9e7-803c8beab75b from mountpoint /dev/sdc
Nov 14 11:09:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Attempting to detach device sdc from instance 722f579b-576b-4154-b380-7fc78dc7b9b9 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:09:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:04 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:04 user nova-compute[75255]:   <source dev="/dev/sdi"/>
Nov 14 11:09:04 user nova-compute[75255]:   <target dev="sdc" bus="scsi"/>
Nov 14 11:09:04 user nova-compute[75255]:   <serial>3a53b75a-1962-4a0b-b9e7-803c8beab75b</serial>
Nov 14 11:09:04 user nova-compute[75255]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 11:09:04 user nova-compute[75255]: </disk>
Nov 14 11:09:04 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Successfully detached device sdc from instance 722f579b-576b-4154-b380-7fc78dc7b9b9 from the persistent domain config.
Nov 14 11:09:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 722f579b-576b-4154-b380-7fc78dc7b9b9 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:09:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:04 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:04 user nova-compute[75255]:   <source dev="/dev/sdi"/>
Nov 14 11:09:04 user nova-compute[75255]:   <target dev="sdc" bus="scsi"/>
Nov 14 11:09:04 user nova-compute[75255]:   <serial>3a53b75a-1962-4a0b-b9e7-803c8beab75b</serial>
Nov 14 11:09:04 user nova-compute[75255]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 11:09:04 user nova-compute[75255]: </disk>
Nov 14 11:09:04 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 1020264448 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:05 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2e186944-c41d-4f07-b852-ff17b2241241 is timed out.
Nov 14 11:09:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Successfully detached device vdb from instance 2e186944-c41d-4f07-b852-ff17b2241241 from the live domain config.
Nov 14 11:09:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDvGweUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:05 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d45d30-bbbb-4ab8-ae77-06acabf02ea1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:05 user nova-compute[75255]: No targets found.
Nov 14 11:09:05 user nova-compute[75255]: iSNS:
Nov 14 11:09:05 user nova-compute[75255]: No targets found.
Nov 14 11:09:05 user nova-compute[75255]: STATIC:
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:05 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:05 user nova-compute[75255]: No targets found.
Nov 14 11:09:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:05 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:05 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 722f579b-576b-4154-b380-7fc78dc7b9b9 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa791d-55f6-4f92-87e0-4b9ddaa8029f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.147s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68b4a32-5332-490e-ae4e-cbdccc635312]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:05 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3380d7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451'): ({'sdf'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Removing single pathed devices sdf {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e48f636-b582-4c9d-b24d-18a4addd7f30]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d796552-3555-4275-be53-2a739e52c54c]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Flushing IO for device /dev/sdf {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6723ce6b-4de3-4963-96c1-4fdd56773116]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.104s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d84114a-f7ed-4ed1-bd78-39e883c62b5e]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.089s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9948874-4162-429e-acf9-d8988aa79138]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:06 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --logout" returned: 0 in 0.148s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63bb3f1-a60d-40fa-ae82-7a8c5b5a2b19]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260]
Nov 14 11:09:06 user nova-compute[75255]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d33fa0-7605-4d36-a523-736eb4f4e451 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cde42d-2180-4cec-a52d-73309f841be3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.785s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] <== disconnect_volume: return (787ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.070s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f612294f-e36e-453c-99e9-596cc8909632]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:06 user nova-compute[75255]: No targets found.
Nov 14 11:09:06 user nova-compute[75255]: iSNS:
Nov 14 11:09:06 user nova-compute[75255]: No targets found.
Nov 14 11:09:06 user nova-compute[75255]: STATIC:
Nov 14 11:09:06 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b
Nov 14 11:09:06 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:06 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:06 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add
Nov 14 11:09:06 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:06 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:06 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:06 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:06 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:06 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49
Nov 14 11:09:06 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:06 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:06 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe
Nov 14 11:09:06 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:06 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:06 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e
Nov 14 11:09:06 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:06 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:06 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:06 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:06 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:06 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:06 user nova-compute[75255]: No targets found.
Nov 14 11:09:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:06 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:06 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f78398d-990d-4247-80b8-98b1d3e3ab2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[048e3a89-a23a-4451-b695-5017a7ab7475]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:06 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3380d6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0'): ({'sdg'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Removing single pathed devices sdg {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54a240-e432-4f3e-a18b-cd9c080b6f69]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0049568c-c423-4e21-8671-99d61c868e37]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Flushing IO for device /dev/sdg {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a060e0b-049b-4f2b-b60e-420072d88a80]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df03805-adc2-4a21-9e21-e423ebe56016]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] SCSI volumes sdg have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a934440-1114-4925-bc4c-d919940b3647]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd408f07-b93c-48b2-8ddd-2ef1d930ad0c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]
Nov 14 11:09:06 user nova-compute[75255]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e67de6c-8148-459d-9b3d-2b590034cd64]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] <== disconnect_volume: return (439ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lazy-loading 'flavor' on Instance uuid 2e186944-c41d-4f07-b852-ff17b2241241 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a678f0bf-821e-4e81-8e75-ad16eca58ed9 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.293s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GonDfeHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2ce264fc-cc38-421a-92ae-41dc6174745d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e226eff9-7c70-42d2-8d08-56826778effe', 'serial'} {{(pid=75255) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 11:09:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] swap_volume: removing Cinder connection for volume e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 {{(pid=75255) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 11:09:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] swap_volume: Updating volume e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "GonDfeHS", "auth_password": "6XbtC8NpJfKI1n", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "e226eff9-7c70-42d2-8d08-56826778effe"}, "status": "reserved", "instance": "2ce264fc-cc38-421a-92ae-41dc6174745d", "attached_at": "", "detached_at": "", "volume_id": "e226eff9-7c70-42d2-8d08-56826778effe", "serial": "e226eff9-7c70-42d2-8d08-56826778effe"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e226eff9-7c70-42d2-8d08-56826778effe', 'no_device': None, 'attachment_id': 'ed1aa427-c3c5-4a01-924a-0de18562fb6b'} {{(pid=75255) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 11:09:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-903facb1-0a70-4dc4-9211-96f25f8bd302 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.636s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG os_brick.utils [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc99004c-ac9d-4342-89f3-4eb135dee97e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d6203-8277-4f5c-9c44-129168a5dfd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a46985c-12ba-418b-a14f-d7c5f87b1860]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a11b5b2-20b2-4dbb-a253-a95b34b0b9b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:08 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:09:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce38afd4-e905-4355-ae04-695c71e8deae]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:09:08 user nova-compute[75255]: DEBUG os_brick.utils [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:08 user nova-compute[75255]: INFO nova.compute.manager [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Swapping volume e226eff9-7c70-42d2-8d08-56826778effe for e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDAZdLRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:10 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:10 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:10 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inLwjkyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:10 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[337948c3-b30a-4366-a64c-344371ddeb54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:09:10 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd6e6e7-03e7-48ca-8868-3ecd17eba347]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847] added
Nov 14 11:09:10 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[de940df2-b301-4cd4-abc1-0c27e89df987]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[de027b02-35a1-45dc-afc1-6b9b5c9dfb92]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDAZdLRV {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDAZdLRV" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05b4793-a489-4c4a-84e4-487aef80d457]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDAZdLRV'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6990f34d-5bb6-42bf-86fb-c7299669a522]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c720a3d3-9d72-4b92-b62b-9a68593ebd24]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a07c44c-8180-4f39-8153-a598616c6461]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260]
Nov 14 11:09:11 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[27939614-6ad8-4bc1-b206-88abe6afc6f1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922a3b0-ad93-478c-adb7-00a33db42fc7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:11 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4fe77-a0b9-4199-b3f2-2973c78c3503]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDAZdLRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23165336261656638', 'path': '/dev/sdf'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165336261656638', 'path': '/dev/sdf'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.349s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:12 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:12 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'flavor' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[249ed746-5013-43cd-bc27-483db55d3edf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:09:12 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:09:12 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:12 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:09:12 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:12 user nova-compute[75255]:   <serial>3036f762-c0ed-48c7-9744-509321c19847</serial>
Nov 14 11:09:12 user nova-compute[75255]: </disk>
Nov 14 11:09:12 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[134122c5-ab1c-461d-8fc3-0fa3f882f7de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d] added
Nov 14 11:09:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ceab7d-c8c1-4d68-9d81-cf4052e2997a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54907f-aa66-44ad-ad8f-263bd22ae712]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inLwjkyS {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inLwjkyS" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f5f63-3514-48a0-af9a-d11cf3a642d7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'inLwjkyS'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a2678-5ecd-4992-b7ad-c6ce1eac4b7a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c27f546-0345-4519-91d6-f71f758440ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f9f89-6f76-455f-b4a5-8671f65b40af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260]
Nov 14 11:09:12 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb0da7b-237a-4aeb-b904-8c47703be6e6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d322a9d-8c7d-4110-81cc-b01b691d1de5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:12 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa73c91-1b14-4273-8634-271dbb740d42]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inLwjkyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No BDM found with device name hda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] No VIF found with MAC fa:16:3e:ab:be:4a, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:09:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cbd40602-d90f-4e8b-b48d-ceac0e72d440 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.467s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] <== connect_volume: return (2729ms) {'type': 'block', 'scsi_wwn': '23165353435666665', 'path': '/dev/sdg'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165353435666665', 'path': '/dev/sdg'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ce264fc-cc38-421a-92ae-41dc6174745d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'serial': 'e0b7daf7-cdf6-4914-85fa-c38cd09c01a0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GonDfeHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'e226eff9-7c70-42d2-8d08-56826778effe'}, 'status': 'reserved', 'instance': '2ce264fc-cc38-421a-92ae-41dc6174745d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e226eff9-7c70-42d2-8d08-56826778effe', 'serial'} {{(pid=75255) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lazy-loading 'flavor' on Instance uuid 41aa15c1-08df-4bc5-907c-36790452a8af {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:13 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:13 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:13 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 11:09:13 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:13 user nova-compute[75255]:   <source dev="/dev/sdg"/>
Nov 14 11:09:13 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:13 user nova-compute[75255]:   <serial>c286590e-49af-4da4-9413-207fff648d1d</serial>
Nov 14 11:09:13 user nova-compute[75255]: </disk>
Nov 14 11:09:13 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c03b8e-951c-42af-98f3-99d14531ee3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:09:13 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ac054-cc6b-4276-ac8b-f874b34ef2e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0] added
Nov 14 11:09:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61bf2f-3a39-4ae0-ab5c-552cd06d8b51]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5246ed12-7608-494b-9c97-bbdcc0a32151]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzKIRtTN {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzKIRtTN" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1505ffbb-edfb-4242-83aa-964a3d52c209]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JzKIRtTN'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16915d6-e6a7-4647-b6b7-219003ac6489]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d5695e-f7b2-44e0-9d25-f0f462d69196]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a32e00-296d-43fb-8030-962221e18b2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]
Nov 14 11:09:13 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d65ed43-91ca-4eb5-99d9-dd62a6f18758]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ecffcf-ced3-475d-b712-f596cd6b614d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:13 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d388e29c-e1c0-47a2-8b93-8c008f8fb19f]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] No VIF found with MAC fa:16:3e:24:23:c0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:09:14 user nova-compute[75255]: INFO nova.compute.manager [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Detaching volume 3036f762-c0ed-48c7-9744-509321c19847
Nov 14 11:09:14 user nova-compute[75255]: INFO nova.virt.block_device [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Attempting to driver detach volume 3036f762-c0ed-48c7-9744-509321c19847 from mountpoint /dev/vdb
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Attempting to detach device vdb from instance d7f63547-b356-471b-825d-6a0b4670221d from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:14 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:14 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:09:14 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:14 user nova-compute[75255]:   <serial>3036f762-c0ed-48c7-9744-509321c19847</serial>
Nov 14 11:09:14 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 11:09:14 user nova-compute[75255]: </disk>
Nov 14 11:09:14 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully detached device vdb from instance d7f63547-b356-471b-825d-6a0b4670221d from the persistent domain config.
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7f63547-b356-471b-825d-6a0b4670221d from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:14 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:14 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:09:14 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:14 user nova-compute[75255]:   <serial>3036f762-c0ed-48c7-9744-509321c19847</serial>
Nov 14 11:09:14 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 11:09:14 user nova-compute[75255]: </disk>
Nov 14 11:09:14 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3e7d6f0a-e8c0-44c3-8efe-5b2ef6e39756 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.943s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23030396331323132', 'path': '/dev/sdj'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030396331323132', 'path': '/dev/sdj'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lazy-loading 'flavor' on Instance uuid 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'flavor' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] volume_snapshot_create: create_info: {'snapshot_id': '3677847b-3f3f-47da-88f7-c0728338c9b6', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75255) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] snap xml: <domainsnapshot>
Nov 14 11:09:15 user nova-compute[75255]:   <disks>
Nov 14 11:09:15 user nova-compute[75255]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 14 11:09:15 user nova-compute[75255]:       <source file="/dev/new_file"/>
Nov 14 11:09:15 user nova-compute[75255]:     </disk>
Nov 14 11:09:15 user nova-compute[75255]:     <disk name="vda" snapshot="no"/>
Nov 14 11:09:15 user nova-compute[75255]:   </disks>
Nov 14 11:09:15 user nova-compute[75255]: </domainsnapshot>
Nov 14 11:09:15 user nova-compute[75255]:  {{(pid=75255) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] Lazy-loading 'system_metadata' on Instance uuid 41aa15c1-08df-4bc5-907c-36790452a8af {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:15 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     rv = execute(f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     six.reraise(c, e, tb)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     raise value
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     rv = meth(*args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     self._volume_snapshot_create(context, instance, guest,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     rv = execute(f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     six.reraise(c, e, tb)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     raise value
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     rv = meth(*args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] 
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e454f12c-7aa7-4058-9d03-b776c0bcad44 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] volume_snapshot_delete: delete_info: {'volume_id': 'c286590e-49af-4da4-9413-207fff648d1d'} {{(pid=75255) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [None req-e454f12c-7aa7-4058-9d03-b776c0bcad44 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af]     if delete_info['type'] != 'qcow2':
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] KeyError: 'type'
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 3677847b-3f3f-47da-88f7-c0728338c9b6 could not be found.
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 3677847b-3f3f-47da-88f7-c0728338c9b6 could not be found. (HTTP 404) (Request-ID: req-b7d9f8be-07f7-4923-9d13-b8fd6bcddd13)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 3677847b-3f3f-47da-88f7-c0728338c9b6 could not be found.
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver [None req-e454f12c-7aa7-4058-9d03-b776c0bcad44 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e4d59f1a-a91c-41d6-a0de-1f3ff6a97c6b)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 11:09:15 user nova-compute[75255]: ERROR nova.virt.libvirt.driver 
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:15 user nova-compute[75255]: INFO nova.compute.manager [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Attaching volume 94c271a1-ddf7-49f9-a84e-b7034f98515e to /dev/vdb
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server [None req-0b764d1c-e343-45e1-9211-221ef8ca0776 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server 
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server [None req-e454f12c-7aa7-4058-9d03-b776c0bcad44 tempest-VolumesAssistedSnapshotsTest-1406273503 tempest-VolumesAssistedSnapshotsTest-1406273503-project] Exception during message handling: KeyError: 'type'
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 11:09:15 user nova-compute[75255]: ERROR oslo_messaging.rpc.server 
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.utils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ade096-2d08-48af-b1f7-be2d821ea4d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d4ed9-d3f0-4b2b-b0a1-08bae3fe7bf3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d65ebfc-7097-4e12-8760-8e4de3eb42fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0538f5e-ebf8-4d6e-8c2c-5c6487018d92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:15 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aeb924-ca25-483b-bb09-fbeb98a41976]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG os_brick.utils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating existing volume attachment record: 0ae200a2-7f3a-4ac2-9147-777b3387832f {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:15 user nova-compute[75255]: INFO nova.compute.manager [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Detaching volume c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:16 user nova-compute[75255]: INFO nova.virt.block_device [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Attempting to driver detach volume c286590e-49af-4da4-9413-207fff648d1d from mountpoint /dev/vdb
Nov 14 11:09:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Attempting to detach device vdb from instance 41aa15c1-08df-4bc5-907c-36790452a8af from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:09:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:16 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:16 user nova-compute[75255]:   <source dev="/dev/sdg"/>
Nov 14 11:09:16 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:16 user nova-compute[75255]:   <serial>c286590e-49af-4da4-9413-207fff648d1d</serial>
Nov 14 11:09:16 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:09:16 user nova-compute[75255]: </disk>
Nov 14 11:09:16 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Successfully detached device vdb from instance 41aa15c1-08df-4bc5-907c-36790452a8af from the persistent domain config.
Nov 14 11:09:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 41aa15c1-08df-4bc5-907c-36790452a8af from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:09:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:16 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:16 user nova-compute[75255]:   <source dev="/dev/sdg"/>
Nov 14 11:09:16 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:16 user nova-compute[75255]:   <serial>c286590e-49af-4da4-9413-207fff648d1d</serial>
Nov 14 11:09:16 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:09:16 user nova-compute[75255]: </disk>
Nov 14 11:09:16 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 331350016 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 41aa15c1-08df-4bc5-907c-36790452a8af {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:09:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 475004928 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-changed-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Refreshing instance network info cache due to event network-changed-ea464f49-6b78-450d-9b10-124c0e2a31d7. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] Acquiring lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] Acquired lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Refreshing network info cache for port ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 938475520 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Updated VIF entry in instance network info cache for port ea464f49-6b78-450d-9b10-124c0e2a31d7. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Updating instance_info_cache with network_info: [{"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4f5e8117-fa4b-4aa2-9a16-f2504422a235 req-e6a81a12-fe94-4475-b3de-f054e5c57a02 service nova] Releasing lock "refresh_cache-71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GonDfeHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'e226eff9-7c70-42d2-8d08-56826778effe'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:19 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ec4db3-375d-4506-8771-a301c9a99375]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:19 user nova-compute[75255]: No targets found.
Nov 14 11:09:19 user nova-compute[75255]: iSNS:
Nov 14 11:09:19 user nova-compute[75255]: No targets found.
Nov 14 11:09:19 user nova-compute[75255]: STATIC:
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:19 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:19 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:19 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:19 user nova-compute[75255]: No targets found.
Nov 14 11:09:19 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:19 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:19 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c6047-f21d-48ec-9d84-cd5a359fe53f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fd0254-d418-437b-8aa6-af70ff9b9b08]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:19 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe (non-flash)
Nov 14 11:09:19 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:19 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe'): ({'sdh'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Removing single pathed devices sdh {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba463b6-54c8-4103-a1eb-87905f45e791]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[416eb071-d281-4f9b-80b2-983accc0f8da]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Flushing IO for device /dev/sdh {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c710928-56f1-44a1-be94-a159bf0b16a0]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae14c727-f448-4518-9730-53e6d79a8693]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] SCSI volumes sdh have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85e0eb-2f23-4bba-b1ec-8bac14a6b497]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[231dab96-7be9-4f6b-95e3-e8bb0d636b91]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260]
Nov 14 11:09:19 user nova-compute[75255]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:19 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e226eff9-7c70-42d2-8d08-56826778effe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b3779-2fe1-47ec-998e-02f7bb374b5e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] <== disconnect_volume: return (369ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '2ce264fc-cc38-421a-92ae-41dc6174745d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'serial'} {{(pid=75255) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 11:09:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] swap_volume: removing Cinder connection for volume e226eff9-7c70-42d2-8d08-56826778effe {{(pid=75255) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] swap_volume: Updating volume e226eff9-7c70-42d2-8d08-56826778effe BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JzKIRtTN", "auth_password": "695YFPBpvHfwQ1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "e0b7daf7-cdf6-4914-85fa-c38cd09c01a0"}, "status": "reserved", "instance": "2ce264fc-cc38-421a-92ae-41dc6174745d", "attached_at": "", "detached_at": "", "volume_id": "e0b7daf7-cdf6-4914-85fa-c38cd09c01a0", "serial": "e0b7daf7-cdf6-4914-85fa-c38cd09c01a0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'no_device': None, 'attachment_id': '183604f9-a07a-4d07-bfef-c37d67f97dc3'} {{(pid=75255) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-303a8f3e-17ef-49bd-86aa-99f66ec5ece4 tempest-TestVolumeSwap-1103678677 tempest-TestVolumeSwap-1103678677-project-admin] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.897s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lazy-loading 'flavor' on Instance uuid 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:20 user nova-compute[75255]: INFO nova.compute.manager [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Attaching volume 6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 to /dev/vdb
Nov 14 11:09:20 user nova-compute[75255]: DEBUG os_brick.utils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fa9490-6547-4321-aef8-120f44b910be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce1ac63-2725-4500-83a9-d293bbfc6da7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc4b7e-cb4e-456d-894d-d069a403dcac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd035412-2a76-4372-a247-623e9ae41416]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:09:20 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:09:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8426afbd-fdce-4da6-ad77-f7320fec2858]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG os_brick.utils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:20 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Updating existing volume attachment record: cb07231a-119b-445e-8617-6848cfaf11c8 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:21 user nova-compute[75255]: INFO nova.compute.manager [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Detaching volume e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:21 user nova-compute[75255]: INFO nova.virt.block_device [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Attempting to driver detach volume e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 from mountpoint /dev/vdb
Nov 14 11:09:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Attempting to detach device vdb from instance 2ce264fc-cc38-421a-92ae-41dc6174745d from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:21 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:21 user nova-compute[75255]:   <source dev="/dev/sdj"/>
Nov 14 11:09:21 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:21 user nova-compute[75255]:   <serial>e0b7daf7-cdf6-4914-85fa-c38cd09c01a0</serial>
Nov 14 11:09:21 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:09:21 user nova-compute[75255]: </disk>
Nov 14 11:09:21 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Successfully detached device vdb from instance 2ce264fc-cc38-421a-92ae-41dc6174745d from the persistent domain config.
Nov 14 11:09:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ce264fc-cc38-421a-92ae-41dc6174745d from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:21 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:21 user nova-compute[75255]:   <source dev="/dev/sdj"/>
Nov 14 11:09:21 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:21 user nova-compute[75255]:   <serial>e0b7daf7-cdf6-4914-85fa-c38cd09c01a0</serial>
Nov 14 11:09:21 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:09:21 user nova-compute[75255]: </disk>
Nov 14 11:09:21 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBvzZJao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:21 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:21 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:21 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aecf7a-f0ac-457f-a1c3-73d282028f93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:09:21 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3260b0ef-d0fb-4d46-87f3-9a33d8656eb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e] added
Nov 14 11:09:21 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bb08be-2958-4cc4-904c-99d4d873cdbd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbea8c0-6721-4575-975d-2f119236a185]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBvzZJao {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBvzZJao" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[09df4db6-04a9-4235-b259-3a65835c3216]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBvzZJao'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd7197-66cb-4264-a508-c4f456d8edcf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5710c546-d1b8-4091-8d6d-14290851235c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:21 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:21 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:21 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[99326100-4a59-495a-89d3-8eee49789158]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]
Nov 14 11:09:22 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a9e79e-7850-4c39-aed0-73f83f7fdd93]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f90c83-d361-429b-b2e7-c15a45dfcf8a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:22 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b62509-543d-48a6-878d-0c5276f3766b]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBvzZJao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26130383534363634', 'path': '/dev/sdh'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130383534363634', 'path': '/dev/sdh'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG nova.objects.instance [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'flavor' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:09:23 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:23 user nova-compute[75255]:   <source dev="/dev/sdh"/>
Nov 14 11:09:23 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:23 user nova-compute[75255]:   <serial>94c271a1-ddf7-49f9-a84e-b7034f98515e</serial>
Nov 14 11:09:23 user nova-compute[75255]: </disk>
Nov 14 11:09:23 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No VIF found with MAC fa:16:3e:98:94:4b, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:09:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-043d80b5-c56e-49f5-84e3-648f8988c287 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.144s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-changed-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing instance network info cache due to event network-changed-c66c1d61-b2d6-4e34-956a-15992fd14efd. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] Acquiring lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] Acquired lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Refreshing network info cache for port c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:09:25 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 722f579b-576b-4154-b380-7fc78dc7b9b9 is timed out.
Nov 14 11:09:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Successfully detached device sdc from instance 722f579b-576b-4154-b380-7fc78dc7b9b9 from the live domain config.
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgAUTEpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:25 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb7d063-206c-4bbb-bfc7-88f84860b30d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:25 user nova-compute[75255]: No targets found.
Nov 14 11:09:25 user nova-compute[75255]: iSNS:
Nov 14 11:09:25 user nova-compute[75255]: No targets found.
Nov 14 11:09:25 user nova-compute[75255]: STATIC:
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:25 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:25 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:25 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:25 user nova-compute[75255]: No targets found.
Nov 14 11:09:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:25 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:25 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[de16ea79-d847-44b7-bf4c-81e49e17a64a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[72efa787-c3db-4f43-b08d-a918ca42d4d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:25 user nova-compute[75255]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b (non-flash)
Nov 14 11:09:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3382c9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b'): ({'sdi'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Removing single pathed devices sdi {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[49979f86-ee81-4557-a032-aeca5caf9c9c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d383c29-910a-4254-bda8-bbb5f34fe4cd]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Flushing IO for device /dev/sdi {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fde0d8-c8ec-4462-b5c0-9a361173ff59]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbcbf16-9994-47d3-8f4e-a6dc78c8cabf]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] SCSI volumes sdi have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updated VIF entry in instance network info cache for port c66c1d61-b2d6-4e34-956a-15992fd14efd. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd78d8-63ba-4161-9a0f-24e702be02e8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a3cd2e99-c8b3-421a-b977-26125287070a req-46ba7861-d854-492e-a329-1aef6e30338d service nova] Releasing lock "refresh_cache-3fa124c3-9e3a-418f-bc95-6bce20b5e47d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97bdb85-c65c-40c2-9bca-046b8fcf7940]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260]
Nov 14 11:09:25 user nova-compute[75255]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrvHbqzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:25 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a53b75a-1962-4a0b-b9e7-803c8beab75b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0585e-7d22-49f0-9f8b-81801a437b52]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] <== disconnect_volume: return (395ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.050s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:25 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:25 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6a68e5-7d48-4313-8325-9c2ddfccba67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:09:25 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7fd449-d3e0-454d-92f5-9e32da2e7eb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0] added
Nov 14 11:09:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8227fa9f-32a8-4d0f-8fdc-9f819af3d0f5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d984e7-6377-458a-b85d-b3b4513f55ee]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrvHbqzX {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrvHbqzX" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef83a28-ccf9-409e-af05-51f8ff17d406]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mrvHbqzX'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[970d5c13-ed1c-4481-bfcf-8c023c23bf98]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599fcca-d73c-42cf-8d9a-19b36a0ae57e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:26 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG nova.objects.instance [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lazy-loading 'flavor' on Instance uuid 722f579b-576b-4154-b380-7fc78dc7b9b9 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-364e9e25-f3a0-439e-ba84-888482f8aa56 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --login" returned: 0 in 1.090s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c379272f-d3af-4eb7-b0c3-db977097dcbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260]
Nov 14 11:09:27 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3c9530-7d3e-4858-b97a-0348a50e162f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff15e5-cbe1-4749-9cbf-19819236ef00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:27 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.400s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b86b84-f291-4b24-bc1e-93b357368a81]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrvHbqzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:27 user nova-compute[75255]: INFO nova.compute.manager [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Terminating instance
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing instance network info cache due to event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] Acquiring lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] Acquired lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.network.neutron [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:27 user nova-compute[75255]: INFO nova.compute.manager [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Terminating instance
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-6900e806-7ca2-4cf0-99ff-e59cc619acb7 req-380a33fd-2994-4cc4-9e3e-28559c3d6a29 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-vif-unplugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6900e806-7ca2-4cf0-99ff-e59cc619acb7 req-380a33fd-2994-4cc4-9e3e-28559c3d6a29 service nova] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6900e806-7ca2-4cf0-99ff-e59cc619acb7 req-380a33fd-2994-4cc4-9e3e-28559c3d6a29 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6900e806-7ca2-4cf0-99ff-e59cc619acb7 req-380a33fd-2994-4cc4-9e3e-28559c3d6a29 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-6900e806-7ca2-4cf0-99ff-e59cc619acb7 req-380a33fd-2994-4cc4-9e3e-28559c3d6a29 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] No waiting events found dispatching network-vif-unplugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-6900e806-7ca2-4cf0-99ff-e59cc619acb7 req-380a33fd-2994-4cc4-9e3e-28559c3d6a29 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-vif-unplugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-e59a7bf9-1a97-4b52-abf8-ab4b746ac79c req-1d17c5d3-1935-4987-afc5-84014c2071ee service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e59a7bf9-1a97-4b52-abf8-ab4b746ac79c req-1d17c5d3-1935-4987-afc5-84014c2071ee service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e59a7bf9-1a97-4b52-abf8-ab4b746ac79c req-1d17c5d3-1935-4987-afc5-84014c2071ee service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e59a7bf9-1a97-4b52-abf8-ab4b746ac79c req-1d17c5d3-1935-4987-afc5-84014c2071ee service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-e59a7bf9-1a97-4b52-abf8-ab4b746ac79c req-1d17c5d3-1935-4987-afc5-84014c2071ee service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-unplugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-e59a7bf9-1a97-4b52-abf8-ab4b746ac79c req-1d17c5d3-1935-4987-afc5-84014c2071ee service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-c66c1d61-b2d6-4e34-956a-15992fd14efd for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.444s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] <== connect_volume: return (2496ms) {'type': 'block', 'scsi_wwn': '23036646337383631', 'path': '/dev/sdi'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036646337383631', 'path': '/dev/sdi'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lazy-loading 'flavor' on Instance uuid 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:09:28 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:28 user nova-compute[75255]:   <source dev="/dev/sdi"/>
Nov 14 11:09:28 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:28 user nova-compute[75255]:   <serial>6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0</serial>
Nov 14 11:09:28 user nova-compute[75255]: </disk>
Nov 14 11:09:28 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Instance destroyed successfully.
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lazy-loading 'resources' on Instance uuid 722f579b-576b-4154-b380-7fc78dc7b9b9 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-486691638',display_name='tempest-AttachSCSIVolumeTestJSON-server-486691638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-486691638',id=7,image_ref='6f014766-2a26-4e7f-ba33-b47a47609633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANexeSEpWU31kpXnFl/up9wLSyasQylrq+E9etq3qHdlyqqIuQr6Sdwe6uFrayitJFL0Odf8rpH74YauEGWNwK+XY2JcGmivNDFfs2pQluuozX+1VHeuzeDXnchPdC2ew==',key_name='tempest-keypair-1081141500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d858f2f138546eaa36f5fd2905ee8c0',ramdisk_id='',reservation_id='r-ywl60khx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6f014766-2a26-4e7f-ba33-b47a47609633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-823122553',owner_user_name='tempest-AttachSCSIVolumeTestJSON-823122553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63f0fece81604357baee475eec22f8a0',uuid=722f579b-576b-4154-b380-7fc78dc7b9b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Converting VIF {"id": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "address": "fa:16:3e:45:87:1d", "network": {"id": "5974bfeb-8552-4d5c-b56e-e1304a342978", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110014450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d858f2f138546eaa36f5fd2905ee8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e8b6c-1f", "ovs_interfaceid": "062e8b6c-1f14-4ae5-af6d-f7479c26ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=062e8b6c-1f14-4ae5-af6d-f7479c26ad46,network=Network(5974bfeb-8552-4d5c-b56e-e1304a342978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e8b6c-1f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG os_vif [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=062e8b6c-1f14-4ae5-af6d-f7479c26ad46,network=Network(5974bfeb-8552-4d5c-b56e-e1304a342978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e8b6c-1f') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap062e8b6c-1f, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f4384bc-7d0e-4c95-be5b-06c2ca03a95d) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updated VIF entry in instance network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e31a9eb7-eadc-40df-8c0e-517a74d092cc req-e91787d9-5768-4176-9b44-b110404a0077 service nova] Releasing lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: INFO os_vif [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=062e8b6c-1f14-4ae5-af6d-f7479c26ad46,network=Network(5974bfeb-8552-4d5c-b56e-e1304a342978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e8b6c-1f')
Nov 14 11:09:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Deleting instance files /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9_del
Nov 14 11:09:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Deletion of /opt/stack/data/nova/instances/722f579b-576b-4154-b380-7fc78dc7b9b9_del complete
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] No VIF found with MAC fa:16:3e:8c:71:a4, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:28 user nova-compute[75255]: INFO nova.compute.manager [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 14 11:09:28 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:09:28 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ed810af-c9d0-45ea-9dbb-ec5f86d7f6bf tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.215s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:29 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Instance destroyed successfully.
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lazy-loading 'resources' on Instance uuid 3fa124c3-9e3a-418f-bc95-6bce20b5e47d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=c66c1d61-b2d6-4e34-956a-15992fd14efd,network=Network(bcc6ae6e-b2ee-4a76-b007-b9314f4fe225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66c1d61-b2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=c66c1d61-b2d6-4e34-956a-15992fd14efd,network=Network(bcc6ae6e-b2ee-4a76-b007-b9314f4fe225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66c1d61-b2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66c1d61-b2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-unplugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-a40baa56-0996-464c-a813-0bc924afa2fd for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:29 user nova-compute[75255]: WARNING nova.compute.manager [req-7b313394-25c7-4d35-b373-ea70c82c4dd0 req-6dd2f717-4b68-43bf-842b-3d7a90a85e09 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-a40baa56-0996-464c-a813-0bc924afa2fd for instance with vm_state active and task_state deleting.
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a4a9b10-bf83-4a8a-b50a-e21a3be7a43d) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Acquiring lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] No waiting events found dispatching network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received unexpected event network-vif-plugged-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 for instance with vm_state active and task_state deleting.
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-unplugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8 for instance with vm_state active and task_state deleting.
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-unplugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-84a98f26-6223-481f-9a63-c43d1488ee23 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING nova.compute.manager [req-9838a034-87eb-4d70-ae27-9a14c9b2a298 req-5ac0b088-23e2-43ec-84ff-fbcde50b3b11 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-84a98f26-6223-481f-9a63-c43d1488ee23 for instance with vm_state active and task_state deleting.
Nov 14 11:09:30 user nova-compute[75255]: INFO os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=c66c1d61-b2d6-4e34-956a-15992fd14efd,network=Network(bcc6ae6e-b2ee-4a76-b007-b9314f4fe225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66c1d61-b2')
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b4c9578-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b4c9578-8a') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b4c9578-8a, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c6c496d-0363-4e7c-a40f-1efd8e20d513) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: INFO os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b4c9578-8a')
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1b:b4,bridge_name='br-int',has_traffic_filtering=True,id=160d9580-cfb1-4334-9d6b-c5462e9ead29,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap160d9580-cf') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1b:b4,bridge_name='br-int',has_traffic_filtering=True,id=160d9580-cfb1-4334-9d6b-c5462e9ead29,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap160d9580-cf') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap160d9580-cf, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e821876-0cb9-4d84-a40e-b357317d453c) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-c66c1d61-b2d6-4e34-956a-15992fd14efd for instance with vm_state active and task_state deleting.
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-unplugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-160d9580-cfb1-4334-9d6b-c5462e9ead29 for instance with vm_state active and task_state deleting.
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-unplugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-819f1bdc-383e-47b7-9838-254fd3a6f250 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING nova.compute.manager [req-5627c16f-c8d8-405d-be11-e552d08b88d4 req-47a8d3e3-b255-47e2-861b-3880af6ec0d9 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-819f1bdc-383e-47b7-9838-254fd3a6f250 for instance with vm_state active and task_state deleting.
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: INFO os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1b:b4,bridge_name='br-int',has_traffic_filtering=True,id=160d9580-cfb1-4334-9d6b-c5462e9ead29,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap160d9580-cf')
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "84a98f26-6223-481f-9a63-c43d1488ee23", "address": "fa:16:3e:26:a5:f7", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a98f26-62", "ovs_interfaceid": "84a98f26-6223-481f-9a63-c43d1488ee23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a5:f7,bridge_name='br-int',has_traffic_filtering=True,id=84a98f26-6223-481f-9a63-c43d1488ee23,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a98f26-62') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a5:f7,bridge_name='br-int',has_traffic_filtering=True,id=84a98f26-6223-481f-9a63-c43d1488ee23,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a98f26-62') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84a98f26-62, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0c52f25-1b42-47a1-8f80-57f33ebde9b2) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: INFO os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a5:f7,bridge_name='br-int',has_traffic_filtering=True,id=84a98f26-6223-481f-9a63-c43d1488ee23,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a98f26-62')
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=819f1bdc-383e-47b7-9838-254fd3a6f250,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819f1bdc-38') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=819f1bdc-383e-47b7-9838-254fd3a6f250,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819f1bdc-38') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap819f1bdc-38, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=871c5220-426a-46f2-89a0-6cb40e987265) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: INFO os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=819f1bdc-383e-47b7-9838-254fd3a6f250,network=Network(4e400d59-a248-414b-b95b-1041c712ee47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819f1bdc-38')
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:25,bridge_name='br-int',has_traffic_filtering=True,id=7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba68e0e-ea') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:25,bridge_name='br-int',has_traffic_filtering=True,id=7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba68e0e-ea') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ba68e0e-ea, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e8a4ed3-f9f0-4889-8201-1674f044e873) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: INFO os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:25,bridge_name='br-int',has_traffic_filtering=True,id=7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba68e0e-ea')
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936339914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936339914',id=12,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBkeQo0JoNoja9oVkkkiPL0ZthqbdNeRZCed8/o7UPp7ZlDWFaoeCgNrMEYNQg/whNrz4Ul0rGsAKLomJaay1BS4PXm/LDKCVxZe+pQsh9cuwi8Fg70whSCfWAsWnApQ==',key_name='tempest-keypair-1288552247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63de7810264641c9a368882026712330',ramdisk_id='',reservation_id='r-duv3a7sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1699162693',owner_user_name='tempest-TaggedBootDevicesTest-1699162693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4365022be23e49c7a122158e94374783',uuid=3fa124c3-9e3a-418f-bc95-6bce20b5e47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converting VIF {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f5:f5,bridge_name='br-int',has_traffic_filtering=True,id=a40baa56-0996-464c-a813-0bc924afa2fd,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40baa56-09') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f5:f5,bridge_name='br-int',has_traffic_filtering=True,id=a40baa56-0996-464c-a813-0bc924afa2fd,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40baa56-09') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa40baa56-09, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ad8e2e7-a59c-4345-9836-d2c218d3cb2c) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:30 user nova-compute[75255]: INFO os_vif [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f5:f5,bridge_name='br-int',has_traffic_filtering=True,id=a40baa56-0996-464c-a813-0bc924afa2fd,network=Network(6056fb18-7916-4c93-bf3a-ba354242254b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40baa56-09')
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOyXEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d98da0-1358-4ff9-9013-817ae7675cf6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:30 user nova-compute[75255]: No targets found.
Nov 14 11:09:30 user nova-compute[75255]: iSNS:
Nov 14 11:09:30 user nova-compute[75255]: No targets found.
Nov 14 11:09:30 user nova-compute[75255]: STATIC:
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:30 user nova-compute[75255]: No targets found.
Nov 14 11:09:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:30 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:30 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[27255c00-7f8b-4ae9-8d69-096a98c6edf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b21048-b78d-4ef9-97ff-f60dcf8dd4c3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:30 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[316a3993-e0e3-4f68-a81c-25f664051b52]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4982b30e-cac4-414f-8f99-8132956d2c37]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d67ad-3832-4b5b-876e-2c612de7cf61]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid '722f579b-576b-4154-b380-7fc78dc7b9b9' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid '722f579b-576b-4154-b380-7fc78dc7b9b9' (instance-00000007)
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5790849-911f-493e-8047-cd9c1eb02f59]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e391b5b9-7799-4df6-bb4c-2026914c6eb7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ff2696-b62e-4d3c-966d-dbd9f5177ffc]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260]
Nov 14 11:09:30 user nova-compute[75255]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454981f-b852-4a03-a67e-bd2caf6f8b49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b1036d-015f-486d-9905-347713ac58ea]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== disconnect_volume: return (377ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVHyrTiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:30 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc651ec0-6ef7-4f95-8e7c-e3e756a88d94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:30 user nova-compute[75255]: No targets found.
Nov 14 11:09:30 user nova-compute[75255]: iSNS:
Nov 14 11:09:30 user nova-compute[75255]: No targets found.
Nov 14 11:09:30 user nova-compute[75255]: STATIC:
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:30 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:30 user nova-compute[75255]: No targets found.
Nov 14 11:09:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:30 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:30 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f643d-9edf-4020-bae0-91f84a42d78d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:30 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Took 2.08 seconds to deallocate network for instance.
Nov 14 11:09:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b5d07-616d-42b9-bf62-22f10aca5f61]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fe2013-4388-46ad-baf1-3270fd1efa36]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef223a7b-f976-42a2-8cac-bfd01d2e5189]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de97e2-61a5-4377-b7b5-1c780838ba2f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:09:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=6853MB free_disk=25.275646209716797GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e313c870-8f86-4b25-aa5b-66a53e04c330]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: INFO nova.compute.manager [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Detaching volume 6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e4f158-5341-4d3f-8044-f221385f0930]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: INFO nova.virt.block_device [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Attempting to driver detach volume 6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 from mountpoint /dev/vdb
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Attempting to detach device vdb from instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:31 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:31 user nova-compute[75255]:   <source dev="/dev/sdi"/>
Nov 14 11:09:31 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:31 user nova-compute[75255]:   <serial>6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0</serial>
Nov 14 11:09:31 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:09:31 user nova-compute[75255]: </disk>
Nov 14 11:09:31 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48f4e5-dc3f-48b6-afff-20a34e8e3b6f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260]
Nov 14 11:09:31 user nova-compute[75255]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Successfully detached device vdb from instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 from the persistent domain config.
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:09:31 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:31 user nova-compute[75255]:   <source dev="/dev/sdi"/>
Nov 14 11:09:31 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:09:31 user nova-compute[75255]:   <serial>6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0</serial>
Nov 14 11:09:31 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:09:31 user nova-compute[75255]: </disk>
Nov 14 11:09:31 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb837ec-8ad2-49c3-a3cf-243f28582add -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d152be16-159b-44a3-a322-6b684e185433]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.780s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== disconnect_volume: return (783ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsnqiQMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:31 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[df06ce43-202f-4772-8d23-906b89004689]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:31 user nova-compute[75255]: No targets found.
Nov 14 11:09:31 user nova-compute[75255]: iSNS:
Nov 14 11:09:31 user nova-compute[75255]: No targets found.
Nov 14 11:09:31 user nova-compute[75255]: STATIC:
Nov 14 11:09:31 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:31 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:31 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:31 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:31 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:31 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:31 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847
Nov 14 11:09:31 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:31 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:31 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:31 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:31 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:31 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:31 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:31 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:31 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e
Nov 14 11:09:31 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:31 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:31 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:31 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:31 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:31 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:31 user nova-compute[75255]: No targets found.
Nov 14 11:09:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:31 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:31 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb97c8-19e0-4cf3-a0ce-9b6fef8d6163]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a1720-a38d-4e70-b4e9-ab40355cacc5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e (non-flash)
Nov 14 11:09:31 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e'): ({'sdd'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Removing single pathed devices sdd {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e5490c-f27a-4be5-b813-d2955d3fbac4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0a7d24-b51d-4d3a-99e0-c24f1bb8d814]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Flushing IO for device /dev/sdd {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532b9b4-373a-4dcf-ad8c-a46b6fc387a1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[369cd30e-fd35-45c1-a121-5f1475eeb203]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.839s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.386s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94fb8d2-b26c-4a3f-84c4-76574dde2ceb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:31 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Deleted allocations for instance 722f579b-576b-4154-b380-7fc78dc7b9b9
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edde243-77d0-4c41-91ab-d46a3b29a7d8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260]
Nov 14 11:09:32 user nova-compute[75255]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:32 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cd9b8-edfe-448f-9853-ad01c2e1520e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e6398-752f-4b55-a270-2df88ba17023]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7bb65a51-1f35-4de0-89ca-5eacc01c9182 tempest-AttachSCSIVolumeTestJSON-823122553 tempest-AttachSCSIVolumeTestJSON-823122553-project-member] Lock "722f579b-576b-4154-b380-7fc78dc7b9b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.587s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] <== disconnect_volume: return (374ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Deleting instance files /opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d_del
Nov 14 11:09:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Deletion of /opt/stack/data/nova/instances/3fa124c3-9e3a-418f-bc95-6bce20b5e47d_del complete
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 41aa15c1-08df-4bc5-907c-36790452a8af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2ce264fc-cc38-421a-92ae-41dc6174745d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3fa124c3-9e3a-418f-bc95-6bce20b5e47d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d7f63547-b356-471b-825d-6a0b4670221d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2e186944-c41d-4f07-b852-ff17b2241241 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:09:32 user nova-compute[75255]: INFO nova.compute.manager [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Took 4.43 seconds to destroy the instance on the hypervisor.
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing instance network info cache due to event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] Acquiring lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] Acquired lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.network.neutron [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-unplugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-unplugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] Acquiring lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] No waiting events found dispatching network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:32 user nova-compute[75255]: WARNING nova.compute.manager [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received unexpected event network-vif-plugged-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e for instance with vm_state active and task_state deleting.
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-37f9df37-7f4a-4f72-95aa-a1dc1d0aa671 req-14b6cd6e-6b37-4733-8d90-eb5a9a423799 service nova] [instance: 722f579b-576b-4154-b380-7fc78dc7b9b9] Received event network-vif-deleted-062e8b6c-1f14-4ae5-af6d-f7479c26ad46 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.network.neutron [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updated VIF entry in instance network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG nova.network.neutron [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-16d335dd-7f8d-4546-ac3c-a9eeb7c88464 req-c5f8d48c-75b3-4076-9d78-9c4e44d7187c service nova] Releasing lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:34 user nova-compute[75255]: INFO nova.compute.manager [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Rebooting instance
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquired lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-deleted-84a98f26-6223-481f-9a63-c43d1488ee23 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:34 user nova-compute[75255]: INFO nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Neutron deleted interface 84a98f26-6223-481f-9a63-c43d1488ee23; detaching it from the instance and deleting it from the info cache
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "819f1bdc-383e-47b7-9838-254fd3a6f250", "address": "fa:16:3e:2e:2e:04", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819f1bdc-38", "ovs_interfaceid": "819f1bdc-383e-47b7-9838-254fd3a6f250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Releasing lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Detach interface failed, port_id=84a98f26-6223-481f-9a63-c43d1488ee23, reason: Instance 3fa124c3-9e3a-418f-bc95-6bce20b5e47d could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-deleted-819f1bdc-383e-47b7-9838-254fd3a6f250 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:34 user nova-compute[75255]: INFO nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Neutron deleted interface 819f1bdc-383e-47b7-9838-254fd3a6f250; detaching it from the instance and deleting it from the info cache
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40baa56-0996-464c-a813-0bc924afa2fd", "address": "fa:16:3e:ba:f5:f5", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40baa56-09", "ovs_interfaceid": "a40baa56-0996-464c-a813-0bc924afa2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Detach interface failed, port_id=819f1bdc-383e-47b7-9838-254fd3a6f250, reason: Instance 3fa124c3-9e3a-418f-bc95-6bce20b5e47d could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-deleted-a40baa56-0996-464c-a813-0bc924afa2fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:34 user nova-compute[75255]: INFO nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Neutron deleted interface a40baa56-0996-464c-a813-0bc924afa2fd; detaching it from the instance and deleting it from the info cache
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [{"id": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "address": "fa:16:3e:11:91:b0", "network": {"id": "bcc6ae6e-b2ee-4a76-b007-b9314f4fe225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-427767096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66c1d61-b2", "ovs_interfaceid": "c66c1d61-b2d6-4e34-956a-15992fd14efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "address": "fa:16:3e:84:32:f3", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4c9578-8a", "ovs_interfaceid": "4b4c9578-8a7b-4ed0-823d-2285f2b2b5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "address": "fa:16:3e:66:1b:b4", "network": {"id": "4e400d59-a248-414b-b95b-1041c712ee47", "bridge": "br-int", "label": "tempest-device-tagging-net1-953735174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap160d9580-cf", "ovs_interfaceid": "160d9580-cfb1-4334-9d6b-c5462e9ead29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "address": "fa:16:3e:ed:eb:25", "network": {"id": "6056fb18-7916-4c93-bf3a-ba354242254b", "bridge": "br-int", "label": "tempest-device-tagging-net2-936249582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "63de7810264641c9a368882026712330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba68e0e-ea", "ovs_interfaceid": "7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-5832c395-4c70-4e58-8b19-cebb51079bfa req-017ee2c8-76de-404e-b608-fd1cdba7067c service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Detach interface failed, port_id=a40baa56-0996-464c-a813-0bc924afa2fd, reason: Instance 3fa124c3-9e3a-418f-bc95-6bce20b5e47d could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:09:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7f63547-b356-471b-825d-6a0b4670221d is timed out.
Nov 14 11:09:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully detached device vdb from instance d7f63547-b356-471b-825d-6a0b4670221d from the live domain config.
Nov 14 11:09:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDAZdLRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:34 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e249d4-190f-460b-af22-649eb81280a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:34 user nova-compute[75255]: No targets found.
Nov 14 11:09:34 user nova-compute[75255]: iSNS:
Nov 14 11:09:34 user nova-compute[75255]: No targets found.
Nov 14 11:09:34 user nova-compute[75255]: STATIC:
Nov 14 11:09:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847
Nov 14 11:09:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:34 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:34 user nova-compute[75255]: No targets found.
Nov 14 11:09:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:34 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:34 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b8cb89-2861-4bca-a5b5-e75fce795d49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f205d7b8-0fee-4a82-a0e8-e5858c5dc6fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff338212dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847'): ({'sdf'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Removing single pathed devices sdf {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[608efb99-d8f6-4499-9527-d67095ae8213]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3227ff3-15b7-43e6-977d-cff7a25f9da6]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Flushing IO for device /dev/sdf {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72b4160-a7d4-47be-945e-06b8e9111ff9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c47887-a701-4fdb-abea-42164d328f97]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e76cf28-6420-48d1-b2d1-f8e2661f2ab2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c01e13-d5fd-4acd-b689-1d8b879a0340]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260]
Nov 14 11:09:35 user nova-compute[75255]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:35 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Took 2.91 seconds to deallocate network for instance.
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-67492d88-8098-4a84-aeac-51b1d41f3eaf req-aecdab33-a89c-4cdb-9bc8-0168ae2e4a68 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-unplugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-67492d88-8098-4a84-aeac-51b1d41f3eaf req-aecdab33-a89c-4cdb-9bc8-0168ae2e4a68 service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-67492d88-8098-4a84-aeac-51b1d41f3eaf req-aecdab33-a89c-4cdb-9bc8-0168ae2e4a68 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-67492d88-8098-4a84-aeac-51b1d41f3eaf req-aecdab33-a89c-4cdb-9bc8-0168ae2e4a68 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-67492d88-8098-4a84-aeac-51b1d41f3eaf req-aecdab33-a89c-4cdb-9bc8-0168ae2e4a68 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-unplugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:35 user nova-compute[75255]: WARNING nova.compute.manager [req-67492d88-8098-4a84-aeac-51b1d41f3eaf req-aecdab33-a89c-4cdb-9bc8-0168ae2e4a68 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received unexpected event network-vif-unplugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with vm_state active and task_state reboot_started_hard.
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3036f762-c0ed-48c7-9744-509321c19847 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47fc1d9-c102-4279-92c6-a80224db752e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] <== disconnect_volume: return (407ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:09:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance destroyed successfully.
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'resources' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1740956480',display_name='tempest-TestMinimumBasicScenario-server-1740956480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1740956480',id=10,image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLubt+BEWN8kJ36V2h8+qu0AjZ1e+g52jEBZdUEat+zmfnZ0m8vxRP4cgbi6UlWVTZdExaSwyq7eCW1mS1l8yvsQy2f7NujuxCqk0iCfPN5M+6iuUYikHric6nqTEkCMkA==',key_name='tempest-TestMinimumBasicScenario-1185292113',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-cmi4zxzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:09:35Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=844fb83b-7dc0-4720-bacc-52917c1d3c6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_vif [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb13a195e-56, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e07d3f7f-2cfe-43e5-92a7-68ba6b358495) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:35 user nova-compute[75255]: INFO os_vif [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56')
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBvzZJao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:35 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492b810-49e4-49bc-9546-17c891706669]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:35 user nova-compute[75255]: No targets found.
Nov 14 11:09:35 user nova-compute[75255]: iSNS:
Nov 14 11:09:35 user nova-compute[75255]: No targets found.
Nov 14 11:09:35 user nova-compute[75255]: STATIC:
Nov 14 11:09:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:35 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:35 user nova-compute[75255]: No targets found.
Nov 14 11:09:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:35 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:35 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc1d1c-d9df-4402-ba05-bf33e1334d0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ef085e-29d4-49af-91d9-976d780565b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:35 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281dc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e'): ({'sdh'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Removing single pathed devices sdh {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0167350-ae3c-4f71-8f5f-cb53ad02eda1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a810f6d0-9c3b-4a3d-b838-c22d7c2742b4]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flushing IO for device /dev/sdh {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cb8b5d-51b1-45b6-9fce-3b87bad655b0]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b2b22-38af-44dd-9f09-88fd78229d14]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] SCSI volumes sdh have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e87731-2667-4e43-a9bb-fa1b83b319af]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c105f0f-26a2-46ae-a8c7-44ffdfb96dfa]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]
Nov 14 11:09:35 user nova-compute[75255]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedbe5a2-9c9e-465a-9eef-e230d0ff1deb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== disconnect_volume: return (317ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Start _get_guest_xml network_info=[{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6b185a70-d273-40c7-a522-1f344ff8db74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '6b185a70-d273-40c7-a522-1f344ff8db74'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '0ae200a2-7f3a-4ac2-9147-777b3387832f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBvzZJao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '844fb83b-7dc0-4720-bacc-52917c1d3c6e', 'attached_at': '', 'detached_at': '', 'volume_id': '94c271a1-ddf7-49f9-a84e-b7034f98515e', 'serial': '94c271a1-ddf7-49f9-a84e-b7034f98515e'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:09:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:09:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6b185a70-d273-40c7-a522-1f344ff8db74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'vcpu_model' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.objects.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Object Instance<844fb83b-7dc0-4720-bacc-52917c1d3c6e> lazy-loaded attributes: resources,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBvzZJao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:35 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:35 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:35 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa611d6-4dec-4581-b3d9-a88a188b7efc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:09:35 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[96139250-3f5e-428d-8b3e-2309f5aef534]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e] added
Nov 14 11:09:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb79f6-375a-4396-b14a-9f9e3041cc09]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'flavor' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e2fef-c152-4309-adb5-e09ac8d338a9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBvzZJao {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBvzZJao" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[803b6112-02af-4bf0-9d26-dc59625f2482]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBvzZJao'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfa5c3b-0920-4359-a591-a7d9bab2d23a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd34ab38-a264-49ab-93a5-4422c5502eaa tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.992s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd85149-9c3e-4f66-82a6-f0427a353e19]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfb698-d410-4743-8383-1be8dc87157d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]
Nov 14 11:09:36 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953e21a-f976-4802-86cd-e579a3d0d779]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c6d8f-3bd5-4114-8371-a90a410c84ce]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:36 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:09:36 user nova-compute[75255]: INFO nova.compute.claims [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Claim successful on node user
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91a21d3-3fd8-4693-89f4-269fecf18ab1]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBvzZJao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-48f12986-02c4-4d92-8245-8d724a5a175e req-d6827a6f-ad08-447a-a53e-32ddbdb95bbf service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-deleted-7ba68e0e-ea1f-4762-bda1-2a8b4edeb70e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-48f12986-02c4-4d92-8245-8d724a5a175e req-d6827a6f-ad08-447a-a53e-32ddbdb95bbf service nova] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Received event network-vif-deleted-c66c1d61-b2d6-4e34-956a-15992fd14efd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:36 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 41aa15c1-08df-4bc5-907c-36790452a8af is timed out.
Nov 14 11:09:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Successfully detached device vdb from instance 41aa15c1-08df-4bc5-907c-36790452a8af from the live domain config.
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inLwjkyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:36 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "interface-d7f63547-b356-471b-825d-6a0b4670221d-7163a946-368a-49f4-b31b-d318ec43eb76" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "interface-d7f63547-b356-471b-825d-6a0b4670221d-7163a946-368a-49f4-b31b-d318ec43eb76" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.objects.instance [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'flavor' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converting VIF {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface> {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface> {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Attempting to detach device tap7163a946-36 from instance d7f63547-b356-471b-825d-6a0b4670221d from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] detach device xml: <interface type="ethernet">
Nov 14 11:09:36 user nova-compute[75255]:   <mac address="fa:16:3e:74:f8:c7"/>
Nov 14 11:09:36 user nova-compute[75255]:   <model type="virtio"/>
Nov 14 11:09:36 user nova-compute[75255]:   <mtu size="1442"/>
Nov 14 11:09:36 user nova-compute[75255]:   <target dev="tap7163a946-36"/>
Nov 14 11:09:36 user nova-compute[75255]: </interface>
Nov 14 11:09:36 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface> {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 11:09:36 user nova-compute[75255]:   <name>instance-00000008</name>
Nov 14 11:09:36 user nova-compute[75255]:   <uuid>d7f63547-b356-471b-825d-6a0b4670221d</uuid>
Nov 14 11:09:36 user nova-compute[75255]:   <metadata>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:36 user nova-compute[75255]:   <nova:package version="0.0.0"/>
Nov 14 11:09:36 user nova-compute[75255]:   <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:09:36 user nova-compute[75255]:   <nova:creationTime>2023-11-14 11:08:59</nova:creationTime>
Nov 14 11:09:36 user nova-compute[75255]:   <nova:flavor name="m1.tiny">
Nov 14 11:09:36 user nova-compute[75255]:     <nova:memory>512</nova:memory>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:disk>1</nova:disk>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:swap>0</nova:swap>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:36 user nova-compute[75255]:   </nova:flavor>
Nov 14 11:09:36 user nova-compute[75255]:   <nova:owner>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:09:36 user nova-compute[75255]:   </nova:owner>
Nov 14 11:09:36 user nova-compute[75255]:   <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:09:36 user nova-compute[75255]:   <nova:ports>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:09:36 user nova-compute[75255]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:09:36 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:36 user nova-compute[75255]:     <nova:port uuid="7163a946-368a-49f4-b31b-d318ec43eb76">
Nov 14 11:09:36 user nova-compute[75255]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 14 11:09:36 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:36 user nova-compute[75255]:   </nova:ports>
Nov 14 11:09:36 user nova-compute[75255]: </nova:instance>
Nov 14 11:09:36 user nova-compute[75255]:   </metadata>
Nov 14 11:09:36 user nova-compute[75255]:   <memory unit='KiB'>524288</memory>
Nov 14 11:09:36 user nova-compute[75255]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 11:09:36 user nova-compute[75255]:   <vcpu placement='static'>1</vcpu>
Nov 14 11:09:36 user nova-compute[75255]:   <resource>
Nov 14 11:09:36 user nova-compute[75255]:     <partition>/machine</partition>
Nov 14 11:09:36 user nova-compute[75255]:   </resource>
Nov 14 11:09:36 user nova-compute[75255]:   <sysinfo type='smbios'>
Nov 14 11:09:36 user nova-compute[75255]:     <system>
Nov 14 11:09:36 user nova-compute[75255]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 11:09:36 user nova-compute[75255]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 11:09:36 user nova-compute[75255]:       <entry name='version'>0.0.0</entry>
Nov 14 11:09:36 user nova-compute[75255]:       <entry name='serial'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:36 user nova-compute[75255]:       <entry name='uuid'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:36 user nova-compute[75255]:       <entry name='family'>Virtual Machine</entry>
Nov 14 11:09:36 user nova-compute[75255]:     </system>
Nov 14 11:09:36 user nova-compute[75255]:   </sysinfo>
Nov 14 11:09:36 user nova-compute[75255]:   <os>
Nov 14 11:09:36 user nova-compute[75255]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 11:09:36 user nova-compute[75255]:     <boot dev='hd'/>
Nov 14 11:09:36 user nova-compute[75255]:     <smbios mode='sysinfo'/>
Nov 14 11:09:36 user nova-compute[75255]:   </os>
Nov 14 11:09:36 user nova-compute[75255]:   <features>
Nov 14 11:09:36 user nova-compute[75255]:     <acpi/>
Nov 14 11:09:36 user nova-compute[75255]:     <apic/>
Nov 14 11:09:36 user nova-compute[75255]:     <vmcoreinfo state='on'/>
Nov 14 11:09:36 user nova-compute[75255]:   </features>
Nov 14 11:09:36 user nova-compute[75255]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 11:09:36 user nova-compute[75255]:     <model fallback='forbid'>Nehalem</model>
Nov 14 11:09:36 user nova-compute[75255]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 11:09:36 user nova-compute[75255]:     <feature policy='require' name='vme'/>
Nov 14 11:09:36 user nova-compute[75255]:     <feature policy='require' name='x2apic'/>
Nov 14 11:09:36 user nova-compute[75255]:     <feature policy='require' name='hypervisor'/>
Nov 14 11:09:36 user nova-compute[75255]:   </cpu>
Nov 14 11:09:36 user nova-compute[75255]:   <clock offset='utc'>
Nov 14 11:09:36 user nova-compute[75255]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 11:09:36 user nova-compute[75255]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 11:09:36 user nova-compute[75255]:     <timer name='hpet' present='no'/>
Nov 14 11:09:36 user nova-compute[75255]:   </clock>
Nov 14 11:09:36 user nova-compute[75255]:   <on_poweroff>destroy</on_poweroff>
Nov 14 11:09:36 user nova-compute[75255]:   <on_reboot>restart</on_reboot>
Nov 14 11:09:36 user nova-compute[75255]:   <on_crash>destroy</on_crash>
Nov 14 11:09:36 user nova-compute[75255]:   <devices>
Nov 14 11:09:36 user nova-compute[75255]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 11:09:36 user nova-compute[75255]:     <disk type='file' device='disk'>
Nov 14 11:09:36 user nova-compute[75255]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 11:09:36 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk' index='2'/>
Nov 14 11:09:36 user nova-compute[75255]:       <backingStore type='file' index='3'>
Nov 14 11:09:36 user nova-compute[75255]:         <format type='raw'/>
Nov 14 11:09:36 user nova-compute[75255]:         <source file='/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96'/>
Nov 14 11:09:36 user nova-compute[75255]:         <backingStore/>
Nov 14 11:09:36 user nova-compute[75255]:       </backingStore>
Nov 14 11:09:36 user nova-compute[75255]:       <target dev='vda' bus='virtio'/>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='virtio-disk0'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </disk>
Nov 14 11:09:36 user nova-compute[75255]:     <disk type='file' device='cdrom'>
Nov 14 11:09:36 user nova-compute[75255]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 11:09:36 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config' index='1'/>
Nov 14 11:09:36 user nova-compute[75255]:       <backingStore/>
Nov 14 11:09:36 user nova-compute[75255]:       <target dev='hda' bus='ide'/>
Nov 14 11:09:36 user nova-compute[75255]:       <readonly/>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='ide0-0-0'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </disk>
Nov 14 11:09:36 user nova-compute[75255]:     <controller type='usb' index='0' model='none'>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='usb'/>
Nov 14 11:09:36 user nova-compute[75255]:     </controller>
Nov 14 11:09:36 user nova-compute[75255]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='pci.0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </controller>
Nov 14 11:09:36 user nova-compute[75255]:     <controller type='ide' index='0'>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='ide'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 11:09:36 user nova-compute[75255]:     </controller>
Nov 14 11:09:36 user nova-compute[75255]:     <interface type='ethernet'>
Nov 14 11:09:36 user nova-compute[75255]:       <mac address='fa:16:3e:ab:be:4a'/>
Nov 14 11:09:36 user nova-compute[75255]:       <target dev='tap7e5074e8-0f'/>
Nov 14 11:09:36 user nova-compute[75255]:       <model type='virtio'/>
Nov 14 11:09:36 user nova-compute[75255]:       <mtu size='1442'/>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='net0'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </interface>
Nov 14 11:09:36 user nova-compute[75255]:     <interface type='ethernet'>
Nov 14 11:09:36 user nova-compute[75255]:       <mac address='fa:16:3e:74:f8:c7'/>
Nov 14 11:09:36 user nova-compute[75255]:       <target dev='tap7163a946-36'/>
Nov 14 11:09:36 user nova-compute[75255]:       <model type='virtio'/>
Nov 14 11:09:36 user nova-compute[75255]:       <mtu size='1442'/>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='net1'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </interface>
Nov 14 11:09:36 user nova-compute[75255]:     <serial type='pty'>
Nov 14 11:09:36 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:36 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:36 user nova-compute[75255]:       <target type='isa-serial' port='0'>
Nov 14 11:09:36 user nova-compute[75255]:         <model name='isa-serial'/>
Nov 14 11:09:36 user nova-compute[75255]:       </target>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </serial>
Nov 14 11:09:36 user nova-compute[75255]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 11:09:36 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:36 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:36 user nova-compute[75255]:       <target type='serial' port='0'/>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </console>
Nov 14 11:09:36 user nova-compute[75255]:     <input type='mouse' bus='ps2'>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='input0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </input>
Nov 14 11:09:36 user nova-compute[75255]:     <input type='keyboard' bus='ps2'>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='input1'/>
Nov 14 11:09:36 user nova-compute[75255]:     </input>
Nov 14 11:09:36 user nova-compute[75255]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 11:09:36 user nova-compute[75255]:       <listen type='address' address='0.0.0.0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </graphics>
Nov 14 11:09:36 user nova-compute[75255]:     <audio id='1' type='none'/>
Nov 14 11:09:36 user nova-compute[75255]:     <video>
Nov 14 11:09:36 user nova-compute[75255]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='video0'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </video>
Nov 14 11:09:36 user nova-compute[75255]:     <memballoon model='virtio'>
Nov 14 11:09:36 user nova-compute[75255]:       <stats period='10'/>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='balloon0'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </memballoon>
Nov 14 11:09:36 user nova-compute[75255]:     <rng model='virtio'>
Nov 14 11:09:36 user nova-compute[75255]:       <backend model='random'>/dev/urandom</backend>
Nov 14 11:09:36 user nova-compute[75255]:       <alias name='rng0'/>
Nov 14 11:09:36 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 11:09:36 user nova-compute[75255]:     </rng>
Nov 14 11:09:36 user nova-compute[75255]:   </devices>
Nov 14 11:09:36 user nova-compute[75255]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 11:09:36 user nova-compute[75255]:     <label>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</label>
Nov 14 11:09:36 user nova-compute[75255]:     <imagelabel>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</imagelabel>
Nov 14 11:09:36 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:36 user nova-compute[75255]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 11:09:36 user nova-compute[75255]:     <label>+64055:+108</label>
Nov 14 11:09:36 user nova-compute[75255]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 11:09:36 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:36 user nova-compute[75255]: </domain>
Nov 14 11:09:36 user nova-compute[75255]:  {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 11:09:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully detached device tap7163a946-36 from instance d7f63547-b356-471b-825d-6a0b4670221d from the persistent domain config.
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] (1/8): Attempting to detach device tap7163a946-36 with device alias net1 from instance d7f63547-b356-471b-825d-6a0b4670221d from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] detach device xml: <interface type="ethernet">
Nov 14 11:09:36 user nova-compute[75255]:   <mac address="fa:16:3e:74:f8:c7"/>
Nov 14 11:09:36 user nova-compute[75255]:   <model type="virtio"/>
Nov 14 11:09:36 user nova-compute[75255]:   <mtu size="1442"/>
Nov 14 11:09:36 user nova-compute[75255]:   <target dev="tap7163a946-36"/>
Nov 14 11:09:36 user nova-compute[75255]: </interface>
Nov 14 11:09:36 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:09:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:09:36 user nova-compute[75255]: DEBUG nova.policy [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52279ec6cb8044ad9b7b81808b7631dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea68b5a52247427da8880074883a4ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:09:37 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Creating image(s)
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "/opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "/opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "/opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-41c901f2-14c5-454a-8a87-ef1e32b0f6fc req-4b7ba6f0-462e-4836-96b6-ddb2c5834090 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41c901f2-14c5-454a-8a87-ef1e32b0f6fc req-4b7ba6f0-462e-4836-96b6-ddb2c5834090 service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41c901f2-14c5-454a-8a87-ef1e32b0f6fc req-4b7ba6f0-462e-4836-96b6-ddb2c5834090 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41c901f2-14c5-454a-8a87-ef1e32b0f6fc req-4b7ba6f0-462e-4836-96b6-ddb2c5834090 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-41c901f2-14c5-454a-8a87-ef1e32b0f6fc req-4b7ba6f0-462e-4836-96b6-ddb2c5834090 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:37 user nova-compute[75255]: WARNING nova.compute.manager [req-41c901f2-14c5-454a-8a87-ef1e32b0f6fc req-4b7ba6f0-462e-4836-96b6-ddb2c5834090 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received unexpected event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with vm_state active and task_state reboot_started_hard.
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Start waiting for the detach event from libvirt for device tap7163a946-36 with device alias net1 for instance d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26130383534363634', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130383534363634', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.607s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ecd57c-f3d7-4e45-94a7-6382e110d4a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:37 user nova-compute[75255]: No targets found.
Nov 14 11:09:37 user nova-compute[75255]: iSNS:
Nov 14 11:09:37 user nova-compute[75255]: No targets found.
Nov 14 11:09:37 user nova-compute[75255]: STATIC:
Nov 14 11:09:37 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d
Nov 14 11:09:37 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:37 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:37 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:37 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:37 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:37 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:37 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:37 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:37 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:37 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:37 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:37 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:37 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:37 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:37 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:37 user nova-compute[75255]: No targets found.
Nov 14 11:09:37 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:37 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:37 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1740956480',display_name='tempest-TestMinimumBasicScenario-server-1740956480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1740956480',id=10,image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLubt+BEWN8kJ36V2h8+qu0AjZ1e+g52jEBZdUEat+zmfnZ0m8vxRP4cgbi6UlWVTZdExaSwyq7eCW1mS1l8yvsQy2f7NujuxCqk0iCfPN5M+6iuUYikHric6nqTEkCMkA==',key_name='tempest-TestMinimumBasicScenario-1185292113',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-cmi4zxzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:09:35Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=844fb83b-7dc0-4720-bacc-52917c1d3c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.objects.instance [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'pci_devices' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b100eed-418d-41aa-9b8f-f6cc5e5beae2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.objects.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Object Instance<844fb83b-7dc0-4720-bacc-52917c1d3c6e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:09:37 user nova-compute[75255]:   <uuid>844fb83b-7dc0-4720-bacc-52917c1d3c6e</uuid>
Nov 14 11:09:37 user nova-compute[75255]:   <name>instance-0000000a</name>
Nov 14 11:09:37 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:09:37 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:09:37 user nova-compute[75255]:   <metadata>
Nov 14 11:09:37 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:37 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:09:37 user nova-compute[75255]:       <nova:name>tempest-TestMinimumBasicScenario-server-1740956480</nova:name>
Nov 14 11:09:37 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:09:35</nova:creationTime>
Nov 14 11:09:37 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:09:37 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:09:37 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:09:37 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:09:37 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:37 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:37 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:09:37 user nova-compute[75255]:       <nova:owner>
Nov 14 11:09:37 user nova-compute[75255]:         <nova:user uuid="b20309458694432394da4ee00f67638b">tempest-TestMinimumBasicScenario-1092480951-project-member</nova:user>
Nov 14 11:09:37 user nova-compute[75255]:         <nova:project uuid="e39b62cd90bd47778d70766751118de4">tempest-TestMinimumBasicScenario-1092480951</nova:project>
Nov 14 11:09:37 user nova-compute[75255]:       </nova:owner>
Nov 14 11:09:37 user nova-compute[75255]:       <nova:root type="image" uuid="6b185a70-d273-40c7-a522-1f344ff8db74"/>
Nov 14 11:09:37 user nova-compute[75255]:       <nova:ports>
Nov 14 11:09:37 user nova-compute[75255]:         <nova:port uuid="b13a195e-5614-4f79-8037-b0a124f021dc">
Nov 14 11:09:37 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:09:37 user nova-compute[75255]:         </nova:port>
Nov 14 11:09:37 user nova-compute[75255]:       </nova:ports>
Nov 14 11:09:37 user nova-compute[75255]:     </nova:instance>
Nov 14 11:09:37 user nova-compute[75255]:   </metadata>
Nov 14 11:09:37 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:09:37 user nova-compute[75255]:     <system>
Nov 14 11:09:37 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:09:37 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:09:37 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:09:37 user nova-compute[75255]:       <entry name="serial">844fb83b-7dc0-4720-bacc-52917c1d3c6e</entry>
Nov 14 11:09:37 user nova-compute[75255]:       <entry name="uuid">844fb83b-7dc0-4720-bacc-52917c1d3c6e</entry>
Nov 14 11:09:37 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:09:37 user nova-compute[75255]:     </system>
Nov 14 11:09:37 user nova-compute[75255]:   </sysinfo>
Nov 14 11:09:37 user nova-compute[75255]:   <os>
Nov 14 11:09:37 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:09:37 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:09:37 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:09:37 user nova-compute[75255]:   </os>
Nov 14 11:09:37 user nova-compute[75255]:   <features>
Nov 14 11:09:37 user nova-compute[75255]:     <acpi/>
Nov 14 11:09:37 user nova-compute[75255]:     <apic/>
Nov 14 11:09:37 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:09:37 user nova-compute[75255]:   </features>
Nov 14 11:09:37 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:09:37 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:09:37 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:09:37 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:09:37 user nova-compute[75255]:   </clock>
Nov 14 11:09:37 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:09:37 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:09:37 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:09:37 user nova-compute[75255]:   </cpu>
Nov 14 11:09:37 user nova-compute[75255]:   <devices>
Nov 14 11:09:37 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:09:37 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:09:37 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk"/>
Nov 14 11:09:37 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:09:37 user nova-compute[75255]:     </disk>
Nov 14 11:09:37 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:09:37 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:09:37 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:09:37 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:09:37 user nova-compute[75255]:       <serial>94c271a1-ddf7-49f9-a84e-b7034f98515e</serial>
Nov 14 11:09:37 user nova-compute[75255]:     </disk>
Nov 14 11:09:37 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:09:37 user nova-compute[75255]:       <mac address="fa:16:3e:98:94:4b"/>
Nov 14 11:09:37 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:09:37 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:09:37 user nova-compute[75255]:       <target dev="tapb13a195e-56"/>
Nov 14 11:09:37 user nova-compute[75255]:     </interface>
Nov 14 11:09:37 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:09:37 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/console.log" append="off"/>
Nov 14 11:09:37 user nova-compute[75255]:     </serial>
Nov 14 11:09:37 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:09:37 user nova-compute[75255]:     <video>
Nov 14 11:09:37 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:09:37 user nova-compute[75255]:     </video>
Nov 14 11:09:37 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:09:37 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:09:37 user nova-compute[75255]:     </rng>
Nov 14 11:09:37 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:09:37 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:09:37 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:09:37 user nova-compute[75255]:     </memballoon>
Nov 14 11:09:37 user nova-compute[75255]:   </devices>
Nov 14 11:09:37 user nova-compute[75255]: </domain>
Nov 14 11:09:37 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807052e-9481-4cb8-ad45-2090bd7d7b64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:37 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:37 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:37 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d'): ({'sdg'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Removing single pathed devices sdg {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d2f3d-69db-408c-bd89-ba6a14dcd965]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd10219-206a-40d7-9ebe-fdd64946d7ee]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Flushing IO for device /dev/sdg {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[df40a406-704b-4d26-970b-5afb9ede2df7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa201c1-6972-431c-a758-cf93f842a9a8]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] SCSI volumes sdg have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.213s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d2422d-31ef-4592-92ae-3247617d4e29]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk 1073741824" returned: 0 in 0.088s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4742c508-9ee6-4a40-a662-791756113895]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260]
Nov 14 11:09:37 user nova-compute[75255]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:37 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Successfully created port: b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c286590e-49af-4da4-9413-207fff648d1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9bca38-ccca-4394-aa1a-935b8e675782]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] <== disconnect_volume: return (1061ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:37 user nova-compute[75255]: INFO nova.compute.manager [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] [instance: 3fa124c3-9e3a-418f-bc95-6bce20b5e47d] Took 2.68 seconds to detach 3 volumes for instance.
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.objects.instance [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'trusted_certs' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.objects.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Object Instance<844fb83b-7dc0-4720-bacc-52917c1d3c6e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.266s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Checking if we can resize image /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:09:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Cannot resize image /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Ensure instance console log exists: /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Cannot resize image /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.objects.instance [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'migration_context' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.objects.base [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Object Instance<844fb83b-7dc0-4720-bacc-52917c1d3c6e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1740956480',display_name='tempest-TestMinimumBasicScenario-server-1740956480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1740956480',id=10,image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLubt+BEWN8kJ36V2h8+qu0AjZ1e+g52jEBZdUEat+zmfnZ0m8vxRP4cgbi6UlWVTZdExaSwyq7eCW1mS1l8yvsQy2f7NujuxCqk0iCfPN5M+6iuUYikHric6nqTEkCMkA==',key_name='tempest-TestMinimumBasicScenario-1185292113',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-cmi4zxzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:09:35Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=844fb83b-7dc0-4720-bacc-52917c1d3c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG os_vif [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c8f46e5-03f4-5728-9039-51611badcb95', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb13a195e-56, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb13a195e-56, col_values=(('qos', UUID('82cdd2f2-bd52-4697-83e9-84c5ce95b553')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb13a195e-56, col_values=(('external_ids', {'iface-id': 'b13a195e-5614-4f79-8037-b0a124f021dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:94:4b', 'vm-uuid': '844fb83b-7dc0-4720-bacc-52917c1d3c6e'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: INFO os_vif [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56')
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:38 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Deleted allocations for instance 3fa124c3-9e3a-418f-bc95-6bce20b5e47d
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Successfully updated port: b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "refresh_cache-647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquired lock "refresh_cache-647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9122021c-9dca-43cd-a3e1-b545a4a165f0 tempest-TaggedBootDevicesTest-1699162693 tempest-TaggedBootDevicesTest-1699162693-project-member] Lock "3fa124c3-9e3a-418f-bc95-6bce20b5e47d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.792s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lazy-loading 'flavor' on Instance uuid 41aa15c1-08df-4bc5-907c-36790452a8af {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f702506d-f942-455a-8c21-782e00776989 tempest-VolumesAssistedSnapshotsTest-1501654781 tempest-VolumesAssistedSnapshotsTest-1501654781-project-admin] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.584s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Updating instance_info_cache with network_info: [{"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Releasing lock "refresh_cache-647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Instance network_info: |[{"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Start _get_guest_xml network_info=[{"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:09:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:09:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-875523292',display_name='tempest-VolumesAdminNegativeTest-server-875523292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-875523292',id=14,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea68b5a52247427da8880074883a4ce6',ramdisk_id='',reservation_id='r-dbms7k1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-222875096',owner_user_name='tempest-VolumesAdminNegativeTest-222875096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:09:37Z,user_data=None,user_id='52279ec6cb8044ad9b7b81808b7631dd',uuid=647e4297-1b9e-45ab-a9f6-9d2d5fb804e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converting VIF {"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:85:02,bridge_name='br-int',has_traffic_filtering=True,id=b3d78822-4393-4b4c-9b91-2cdff14b0aa3,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d78822-43') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lazy-loading 'pci_devices' on Instance uuid 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:09:38 user nova-compute[75255]:   <uuid>647e4297-1b9e-45ab-a9f6-9d2d5fb804e7</uuid>
Nov 14 11:09:38 user nova-compute[75255]:   <name>instance-0000000e</name>
Nov 14 11:09:38 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:09:38 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:09:38 user nova-compute[75255]:   <metadata>
Nov 14 11:09:38 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:38 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:09:38 user nova-compute[75255]:       <nova:name>tempest-VolumesAdminNegativeTest-server-875523292</nova:name>
Nov 14 11:09:38 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:09:38</nova:creationTime>
Nov 14 11:09:38 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:09:38 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:09:38 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:09:38 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:09:38 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:38 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:38 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:09:38 user nova-compute[75255]:       <nova:owner>
Nov 14 11:09:38 user nova-compute[75255]:         <nova:user uuid="52279ec6cb8044ad9b7b81808b7631dd">tempest-VolumesAdminNegativeTest-222875096-project-member</nova:user>
Nov 14 11:09:38 user nova-compute[75255]:         <nova:project uuid="ea68b5a52247427da8880074883a4ce6">tempest-VolumesAdminNegativeTest-222875096</nova:project>
Nov 14 11:09:38 user nova-compute[75255]:       </nova:owner>
Nov 14 11:09:38 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:09:38 user nova-compute[75255]:       <nova:ports>
Nov 14 11:09:38 user nova-compute[75255]:         <nova:port uuid="b3d78822-4393-4b4c-9b91-2cdff14b0aa3">
Nov 14 11:09:38 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:09:38 user nova-compute[75255]:         </nova:port>
Nov 14 11:09:38 user nova-compute[75255]:       </nova:ports>
Nov 14 11:09:38 user nova-compute[75255]:     </nova:instance>
Nov 14 11:09:38 user nova-compute[75255]:   </metadata>
Nov 14 11:09:38 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:09:38 user nova-compute[75255]:     <system>
Nov 14 11:09:38 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:09:38 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:09:38 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:09:38 user nova-compute[75255]:       <entry name="serial">647e4297-1b9e-45ab-a9f6-9d2d5fb804e7</entry>
Nov 14 11:09:38 user nova-compute[75255]:       <entry name="uuid">647e4297-1b9e-45ab-a9f6-9d2d5fb804e7</entry>
Nov 14 11:09:38 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:09:38 user nova-compute[75255]:     </system>
Nov 14 11:09:38 user nova-compute[75255]:   </sysinfo>
Nov 14 11:09:38 user nova-compute[75255]:   <os>
Nov 14 11:09:38 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:09:38 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:09:38 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:09:38 user nova-compute[75255]:   </os>
Nov 14 11:09:38 user nova-compute[75255]:   <features>
Nov 14 11:09:38 user nova-compute[75255]:     <acpi/>
Nov 14 11:09:38 user nova-compute[75255]:     <apic/>
Nov 14 11:09:38 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:09:38 user nova-compute[75255]:   </features>
Nov 14 11:09:38 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:09:38 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:09:38 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:09:38 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:09:38 user nova-compute[75255]:   </clock>
Nov 14 11:09:38 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:09:38 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:09:38 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:09:38 user nova-compute[75255]:   </cpu>
Nov 14 11:09:38 user nova-compute[75255]:   <devices>
Nov 14 11:09:38 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:09:38 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:09:38 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk"/>
Nov 14 11:09:38 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:09:38 user nova-compute[75255]:     </disk>
Nov 14 11:09:38 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:09:38 user nova-compute[75255]:       <mac address="fa:16:3e:14:85:02"/>
Nov 14 11:09:38 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:09:38 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:09:38 user nova-compute[75255]:       <target dev="tapb3d78822-43"/>
Nov 14 11:09:38 user nova-compute[75255]:     </interface>
Nov 14 11:09:38 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:09:38 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/console.log" append="off"/>
Nov 14 11:09:38 user nova-compute[75255]:     </serial>
Nov 14 11:09:38 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:09:38 user nova-compute[75255]:     <video>
Nov 14 11:09:38 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:09:38 user nova-compute[75255]:     </video>
Nov 14 11:09:38 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:09:38 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:09:38 user nova-compute[75255]:     </rng>
Nov 14 11:09:38 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:09:38 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:09:38 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:09:38 user nova-compute[75255]:     </memballoon>
Nov 14 11:09:38 user nova-compute[75255]:   </devices>
Nov 14 11:09:38 user nova-compute[75255]: </domain>
Nov 14 11:09:38 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-875523292',display_name='tempest-VolumesAdminNegativeTest-server-875523292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-875523292',id=14,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea68b5a52247427da8880074883a4ce6',ramdisk_id='',reservation_id='r-dbms7k1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-222875096',owner_user_name='tempest-VolumesAdminNegativeTest-222875096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:09:37Z,user_data=None,user_id='52279ec6cb8044ad9b7b81808b7631dd',uuid=647e4297-1b9e-45ab-a9f6-9d2d5fb804e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converting VIF {"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:85:02,bridge_name='br-int',has_traffic_filtering=True,id=b3d78822-4393-4b4c-9b91-2cdff14b0aa3,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d78822-43') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG os_vif [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:85:02,bridge_name='br-int',has_traffic_filtering=True,id=b3d78822-4393-4b4c-9b91-2cdff14b0aa3,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d78822-43') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb837b44-c1b8-590d-8289-f87938fab920', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3d78822-43, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3d78822-43, col_values=(('qos', UUID('d5aa9f83-eddd-44f5-b623-ffb37a21fe2e')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3d78822-43, col_values=(('external_ids', {'iface-id': 'b3d78822-4393-4b4c-9b91-2cdff14b0aa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:85:02', 'vm-uuid': '647e4297-1b9e-45ab-a9f6-9d2d5fb804e7'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:38 user nova-compute[75255]: INFO os_vif [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:85:02,bridge_name='br-int',has_traffic_filtering=True,id=b3d78822-4393-4b4c-9b91-2cdff14b0aa3,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d78822-43')
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] No VIF found with MAC fa:16:3e:14:85:02, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-unplugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-unplugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:39 user nova-compute[75255]: WARNING nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received unexpected event network-vif-unplugged-7163a946-368a-49f4-b31b-d318ec43eb76 for instance with vm_state active and task_state None.
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:39 user nova-compute[75255]: WARNING nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received unexpected event network-vif-plugged-7163a946-368a-49f4-b31b-d318ec43eb76 for instance with vm_state active and task_state None.
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Received event network-changed-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Refreshing instance network info cache due to event network-changed-b3d78822-4393-4b4c-9b91-2cdff14b0aa3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Acquiring lock "refresh_cache-647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Acquired lock "refresh_cache-647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.network.neutron [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Refreshing network info cache for port b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.network.neutron [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Updated VIF entry in instance network info cache for port b3d78822-4393-4b4c-9b91-2cdff14b0aa3. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG nova.network.neutron [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Updating instance_info_cache with network_info: [{"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-820aa4df-72a4-4504-a2a0-0cea9cf9d3e6 req-2e8bbbe2-6dc8-4600-a5f3-f9bff56e27a1 service nova] Releasing lock "refresh_cache-647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:41 user nova-compute[75255]: WARNING nova.compute.manager [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received unexpected event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with vm_state active and task_state reboot_started_hard.
Nov 14 11:09:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:41 user nova-compute[75255]: WARNING nova.compute.manager [req-08b0823c-6273-4d56-8c4a-b0e8656cc245 req-42f7a4c1-a51f-4f45-8034-f0e011a3adf4 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received unexpected event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with vm_state active and task_state reboot_started_hard.
Nov 14 11:09:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:41 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ce264fc-cc38-421a-92ae-41dc6174745d is timed out.
Nov 14 11:09:41 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Successfully detached device vdb from instance 2ce264fc-cc38-421a-92ae-41dc6174745d from the live domain config.
Nov 14 11:09:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKIRtTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'e0b7daf7-cdf6-4914-85fa-c38cd09c01a0'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:41 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f64b82-0a13-4cfc-8e55-f4a7a6d0d8d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:41 user nova-compute[75255]: No targets found.
Nov 14 11:09:41 user nova-compute[75255]: iSNS:
Nov 14 11:09:41 user nova-compute[75255]: No targets found.
Nov 14 11:09:41 user nova-compute[75255]: STATIC:
Nov 14 11:09:41 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0
Nov 14 11:09:41 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:41 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:41 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:41 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:41 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:41 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:41 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:41 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:41 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:41 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:41 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:41 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:41 user nova-compute[75255]: No targets found.
Nov 14 11:09:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:41 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:41 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f4bb7-f922-4776-b569-6f7233d1e557]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b655e3-a6ff-44a7-b115-57f08eb977c7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:41 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:41 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:41 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 (non-flash)
Nov 14 11:09:41 user nova-compute[75255]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:41 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:41 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:41 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0'): ({'sdj'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Removing single pathed devices sdj {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6892e-40b7-49bc-a0fe-5c0dc1ba49d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e0fdd9-6370-4100-9859-a53aac08f46c]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Flushing IO for device /dev/sdj {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3c3d64-c2e1-4dbb-be2a-80b93f8b49fd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce1c59-2929-4448-86b6-e696989dcd68]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] SCSI volumes sdj have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c59f486-e6fc-46a5-9a47-e299dd6866dc]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f097b4d-ed05-4b15-85c8-1f73d79252bc]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260]
Nov 14 11:09:42 user nova-compute[75255]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b7daf7-cdf6-4914-85fa-c38cd09c01a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a10f0a-393e-434d-9f3a-300d82ede90d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] <== disconnect_volume: return (306ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lazy-loading 'flavor' on Instance uuid 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0502c0c3-486b-49f4-9908-0e1624d07045 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.922s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:09:43 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Instance spawned successfully.
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:09:43 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance rebooted successfully.
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Received event network-vif-plugged-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] Acquiring lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] No waiting events found dispatching network-vif-plugged-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:43 user nova-compute[75255]: WARNING nova.compute.manager [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Received unexpected event network-vif-plugged-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 for instance with vm_state building and task_state spawning.
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Received event network-vif-plugged-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] Acquiring lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] No waiting events found dispatching network-vif-plugged-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:09:43 user nova-compute[75255]: WARNING nova.compute.manager [req-ebe54df2-abbe-496b-8a59-282c2406ec04 req-ff52a591-b874-4d4e-97c4-884ee1398474 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Received unexpected event network-vif-plugged-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 for instance with vm_state building and task_state spawning.
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-842e88ba-590f-444e-9fa9-ddbadbe61d18 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.324s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:43 user nova-compute[75255]: INFO nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 14 11:09:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:09:43 user nova-compute[75255]: INFO nova.compute.manager [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Took 7.26 seconds to build instance.
Nov 14 11:09:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0a434044-49af-452f-b3c7-298538ba0187 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.350s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:09:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:09:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:09:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:09:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:52 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 is timed out.
Nov 14 11:09:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Successfully detached device vdb from instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 from the live domain config.
Nov 14 11:09:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrvHbqzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:09:52 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caae568-85e3-4f91-baa9-ec74f9778e17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:09:52 user nova-compute[75255]: No targets found.
Nov 14 11:09:52 user nova-compute[75255]: iSNS:
Nov 14 11:09:52 user nova-compute[75255]: No targets found.
Nov 14 11:09:52 user nova-compute[75255]: STATIC:
Nov 14 11:09:52 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:09:52 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:52 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:52 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0
Nov 14 11:09:52 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:52 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:52 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:09:52 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:09:52 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:09:52 user nova-compute[75255]: FIRMWARE:
Nov 14 11:09:52 user nova-compute[75255]: No targets found.
Nov 14 11:09:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:09:52 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:09:52 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde2d0ab-c09f-4653-a635-b51b22f39a94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[80168ccd-5232-4869-9307-da052244b02f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:52 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:52 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 (non-flash)
Nov 14 11:09:52 user nova-compute[75255]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:09:52 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:09:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0'): ({'sdi'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Removing single pathed devices sdi {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ebc4b2-ec90-4525-9cae-09949b189cef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d2522-7623-4a82-adbe-7ee694a5d45a]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Flushing IO for device /dev/sdi {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e8a155-ef36-4d64-81a3-08d88e5d9cc8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5820bd-a3a3-4004-8b2f-859b7f9d35c7]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] SCSI volumes sdi have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a488d46d-b82f-4d47-933b-c93bf0d58939]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f12fc8-84da-4ca1-a180-bae5489b02c1]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260]
Nov 14 11:09:52 user nova-compute[75255]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0, portal: 172.16.0.220,3260] successful.
Nov 14 11:09:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8f7fc3-e44d-4af0-a1a5-fd917875ddb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49f2ac1-ea5a-4b0f-bff5-44e3e45c36b5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] <== disconnect_volume: return (287ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:09:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:09:53 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lazy-loading 'flavor' on Instance uuid 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4084c1de-33b2-42cf-a3fa-da8fe4259712 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Waiting for libvirt event about the detach of device tap7163a946-36 with device alias net1 from instance d7f63547-b356-471b-825d-6a0b4670221d is timed out.
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface> {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 11:09:57 user nova-compute[75255]:   <name>instance-00000008</name>
Nov 14 11:09:57 user nova-compute[75255]:   <uuid>d7f63547-b356-471b-825d-6a0b4670221d</uuid>
Nov 14 11:09:57 user nova-compute[75255]:   <metadata>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:57 user nova-compute[75255]:   <nova:package version="0.0.0"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:creationTime>2023-11-14 11:08:59</nova:creationTime>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:flavor name="m1.tiny">
Nov 14 11:09:57 user nova-compute[75255]:     <nova:memory>512</nova:memory>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:disk>1</nova:disk>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:swap>0</nova:swap>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:flavor>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:ports>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:09:57 user nova-compute[75255]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:09:57 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:port uuid="7163a946-368a-49f4-b31b-d318ec43eb76">
Nov 14 11:09:57 user nova-compute[75255]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 14 11:09:57 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:ports>
Nov 14 11:09:57 user nova-compute[75255]: </nova:instance>
Nov 14 11:09:57 user nova-compute[75255]:   </metadata>
Nov 14 11:09:57 user nova-compute[75255]:   <memory unit='KiB'>524288</memory>
Nov 14 11:09:57 user nova-compute[75255]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 11:09:57 user nova-compute[75255]:   <vcpu placement='static'>1</vcpu>
Nov 14 11:09:57 user nova-compute[75255]:   <resource>
Nov 14 11:09:57 user nova-compute[75255]:     <partition>/machine</partition>
Nov 14 11:09:57 user nova-compute[75255]:   </resource>
Nov 14 11:09:57 user nova-compute[75255]:   <sysinfo type='smbios'>
Nov 14 11:09:57 user nova-compute[75255]:     <system>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='version'>0.0.0</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='serial'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='uuid'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='family'>Virtual Machine</entry>
Nov 14 11:09:57 user nova-compute[75255]:     </system>
Nov 14 11:09:57 user nova-compute[75255]:   </sysinfo>
Nov 14 11:09:57 user nova-compute[75255]:   <os>
Nov 14 11:09:57 user nova-compute[75255]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 11:09:57 user nova-compute[75255]:     <boot dev='hd'/>
Nov 14 11:09:57 user nova-compute[75255]:     <smbios mode='sysinfo'/>
Nov 14 11:09:57 user nova-compute[75255]:   </os>
Nov 14 11:09:57 user nova-compute[75255]:   <features>
Nov 14 11:09:57 user nova-compute[75255]:     <acpi/>
Nov 14 11:09:57 user nova-compute[75255]:     <apic/>
Nov 14 11:09:57 user nova-compute[75255]:     <vmcoreinfo state='on'/>
Nov 14 11:09:57 user nova-compute[75255]:   </features>
Nov 14 11:09:57 user nova-compute[75255]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 11:09:57 user nova-compute[75255]:     <model fallback='forbid'>Nehalem</model>
Nov 14 11:09:57 user nova-compute[75255]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='vme'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='x2apic'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='hypervisor'/>
Nov 14 11:09:57 user nova-compute[75255]:   </cpu>
Nov 14 11:09:57 user nova-compute[75255]:   <clock offset='utc'>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='hpet' present='no'/>
Nov 14 11:09:57 user nova-compute[75255]:   </clock>
Nov 14 11:09:57 user nova-compute[75255]:   <on_poweroff>destroy</on_poweroff>
Nov 14 11:09:57 user nova-compute[75255]:   <on_reboot>restart</on_reboot>
Nov 14 11:09:57 user nova-compute[75255]:   <on_crash>destroy</on_crash>
Nov 14 11:09:57 user nova-compute[75255]:   <devices>
Nov 14 11:09:57 user nova-compute[75255]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 11:09:57 user nova-compute[75255]:     <disk type='file' device='disk'>
Nov 14 11:09:57 user nova-compute[75255]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 11:09:57 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk' index='2'/>
Nov 14 11:09:57 user nova-compute[75255]:       <backingStore type='file' index='3'>
Nov 14 11:09:57 user nova-compute[75255]:         <format type='raw'/>
Nov 14 11:09:57 user nova-compute[75255]:         <source file='/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96'/>
Nov 14 11:09:57 user nova-compute[75255]:         <backingStore/>
Nov 14 11:09:57 user nova-compute[75255]:       </backingStore>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='vda' bus='virtio'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='virtio-disk0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </disk>
Nov 14 11:09:57 user nova-compute[75255]:     <disk type='file' device='cdrom'>
Nov 14 11:09:57 user nova-compute[75255]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 11:09:57 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config' index='1'/>
Nov 14 11:09:57 user nova-compute[75255]:       <backingStore/>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='hda' bus='ide'/>
Nov 14 11:09:57 user nova-compute[75255]:       <readonly/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='ide0-0-0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </disk>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='usb' index='0' model='none'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='usb'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='pci.0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='ide' index='0'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='ide'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <interface type='ethernet'>
Nov 14 11:09:57 user nova-compute[75255]:       <mac address='fa:16:3e:ab:be:4a'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='tap7e5074e8-0f'/>
Nov 14 11:09:57 user nova-compute[75255]:       <model type='virtio'/>
Nov 14 11:09:57 user nova-compute[75255]:       <mtu size='1442'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='net0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </interface>
Nov 14 11:09:57 user nova-compute[75255]:     <serial type='pty'>
Nov 14 11:09:57 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:57 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target type='isa-serial' port='0'>
Nov 14 11:09:57 user nova-compute[75255]:         <model name='isa-serial'/>
Nov 14 11:09:57 user nova-compute[75255]:       </target>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </serial>
Nov 14 11:09:57 user nova-compute[75255]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 11:09:57 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:57 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target type='serial' port='0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </console>
Nov 14 11:09:57 user nova-compute[75255]:     <input type='mouse' bus='ps2'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='input0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </input>
Nov 14 11:09:57 user nova-compute[75255]:     <input type='keyboard' bus='ps2'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='input1'/>
Nov 14 11:09:57 user nova-compute[75255]:     </input>
Nov 14 11:09:57 user nova-compute[75255]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 11:09:57 user nova-compute[75255]:       <listen type='address' address='0.0.0.0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </graphics>
Nov 14 11:09:57 user nova-compute[75255]:     <audio id='1' type='none'/>
Nov 14 11:09:57 user nova-compute[75255]:     <video>
Nov 14 11:09:57 user nova-compute[75255]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='video0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </video>
Nov 14 11:09:57 user nova-compute[75255]:     <memballoon model='virtio'>
Nov 14 11:09:57 user nova-compute[75255]:       <stats period='10'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='balloon0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </memballoon>
Nov 14 11:09:57 user nova-compute[75255]:     <rng model='virtio'>
Nov 14 11:09:57 user nova-compute[75255]:       <backend model='random'>/dev/urandom</backend>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='rng0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </rng>
Nov 14 11:09:57 user nova-compute[75255]:   </devices>
Nov 14 11:09:57 user nova-compute[75255]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 11:09:57 user nova-compute[75255]:     <label>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</label>
Nov 14 11:09:57 user nova-compute[75255]:     <imagelabel>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</imagelabel>
Nov 14 11:09:57 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:57 user nova-compute[75255]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 11:09:57 user nova-compute[75255]:     <label>+64055:+108</label>
Nov 14 11:09:57 user nova-compute[75255]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 11:09:57 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:57 user nova-compute[75255]: </domain>
Nov 14 11:09:57 user nova-compute[75255]:  {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 11:09:57 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully detached device tap7163a946-36 from instance d7f63547-b356-471b-825d-6a0b4670221d from the live domain config.
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converting VIF {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG os_vif [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7163a946-36, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b537b67-c05f-4e5e-a281-a55b70f283ef) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: INFO os_vif [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36')
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:57 user nova-compute[75255]:   <nova:package version="0.0.0"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:creationTime>2023-11-14 11:09:57</nova:creationTime>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:flavor name="m1.tiny">
Nov 14 11:09:57 user nova-compute[75255]:     <nova:memory>512</nova:memory>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:disk>1</nova:disk>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:swap>0</nova:swap>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:flavor>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:ports>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:09:57 user nova-compute[75255]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:09:57 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:ports>
Nov 14 11:09:57 user nova-compute[75255]: </nova:instance>
Nov 14 11:09:57 user nova-compute[75255]:  {{(pid=75255) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-deleted-7163a946-368a-49f4-b31b-d318ec43eb76 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:09:57 user nova-compute[75255]: INFO nova.compute.manager [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Neutron deleted interface 7163a946-368a-49f4-b31b-d318ec43eb76; detaching it from the instance and deleting it from the info cache
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquired lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.neutron [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.objects.instance [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Lazy-loading 'system_metadata' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.objects.instance [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Lazy-loading 'flavor' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.objects.base [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Object Instance<d7f63547-b356-471b-825d-6a0b4670221d> lazy-loaded attributes: system_metadata,flavor {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Converting VIF {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface> {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 11:09:57 user nova-compute[75255]:   <name>instance-00000008</name>
Nov 14 11:09:57 user nova-compute[75255]:   <uuid>d7f63547-b356-471b-825d-6a0b4670221d</uuid>
Nov 14 11:09:57 user nova-compute[75255]:   <metadata>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:57 user nova-compute[75255]:   <nova:package version="0.0.0"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:creationTime>2023-11-14 11:09:57</nova:creationTime>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:flavor name="m1.tiny">
Nov 14 11:09:57 user nova-compute[75255]:     <nova:memory>512</nova:memory>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:disk>1</nova:disk>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:swap>0</nova:swap>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:flavor>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:ports>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:09:57 user nova-compute[75255]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:09:57 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:ports>
Nov 14 11:09:57 user nova-compute[75255]: </nova:instance>
Nov 14 11:09:57 user nova-compute[75255]:   </metadata>
Nov 14 11:09:57 user nova-compute[75255]:   <memory unit='KiB'>524288</memory>
Nov 14 11:09:57 user nova-compute[75255]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 11:09:57 user nova-compute[75255]:   <vcpu placement='static'>1</vcpu>
Nov 14 11:09:57 user nova-compute[75255]:   <resource>
Nov 14 11:09:57 user nova-compute[75255]:     <partition>/machine</partition>
Nov 14 11:09:57 user nova-compute[75255]:   </resource>
Nov 14 11:09:57 user nova-compute[75255]:   <sysinfo type='smbios'>
Nov 14 11:09:57 user nova-compute[75255]:     <system>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='version'>0.0.0</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='serial'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='uuid'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='family'>Virtual Machine</entry>
Nov 14 11:09:57 user nova-compute[75255]:     </system>
Nov 14 11:09:57 user nova-compute[75255]:   </sysinfo>
Nov 14 11:09:57 user nova-compute[75255]:   <os>
Nov 14 11:09:57 user nova-compute[75255]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 11:09:57 user nova-compute[75255]:     <boot dev='hd'/>
Nov 14 11:09:57 user nova-compute[75255]:     <smbios mode='sysinfo'/>
Nov 14 11:09:57 user nova-compute[75255]:   </os>
Nov 14 11:09:57 user nova-compute[75255]:   <features>
Nov 14 11:09:57 user nova-compute[75255]:     <acpi/>
Nov 14 11:09:57 user nova-compute[75255]:     <apic/>
Nov 14 11:09:57 user nova-compute[75255]:     <vmcoreinfo state='on'/>
Nov 14 11:09:57 user nova-compute[75255]:   </features>
Nov 14 11:09:57 user nova-compute[75255]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 11:09:57 user nova-compute[75255]:     <model fallback='forbid'>Nehalem</model>
Nov 14 11:09:57 user nova-compute[75255]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='vme'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='x2apic'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='hypervisor'/>
Nov 14 11:09:57 user nova-compute[75255]:   </cpu>
Nov 14 11:09:57 user nova-compute[75255]:   <clock offset='utc'>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='hpet' present='no'/>
Nov 14 11:09:57 user nova-compute[75255]:   </clock>
Nov 14 11:09:57 user nova-compute[75255]:   <on_poweroff>destroy</on_poweroff>
Nov 14 11:09:57 user nova-compute[75255]:   <on_reboot>restart</on_reboot>
Nov 14 11:09:57 user nova-compute[75255]:   <on_crash>destroy</on_crash>
Nov 14 11:09:57 user nova-compute[75255]:   <devices>
Nov 14 11:09:57 user nova-compute[75255]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 11:09:57 user nova-compute[75255]:     <disk type='file' device='disk'>
Nov 14 11:09:57 user nova-compute[75255]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 11:09:57 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk' index='2'/>
Nov 14 11:09:57 user nova-compute[75255]:       <backingStore type='file' index='3'>
Nov 14 11:09:57 user nova-compute[75255]:         <format type='raw'/>
Nov 14 11:09:57 user nova-compute[75255]:         <source file='/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96'/>
Nov 14 11:09:57 user nova-compute[75255]:         <backingStore/>
Nov 14 11:09:57 user nova-compute[75255]:       </backingStore>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='vda' bus='virtio'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='virtio-disk0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </disk>
Nov 14 11:09:57 user nova-compute[75255]:     <disk type='file' device='cdrom'>
Nov 14 11:09:57 user nova-compute[75255]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 11:09:57 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config' index='1'/>
Nov 14 11:09:57 user nova-compute[75255]:       <backingStore/>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='hda' bus='ide'/>
Nov 14 11:09:57 user nova-compute[75255]:       <readonly/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='ide0-0-0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </disk>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='usb' index='0' model='none'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='usb'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='pci.0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='ide' index='0'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='ide'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <interface type='ethernet'>
Nov 14 11:09:57 user nova-compute[75255]:       <mac address='fa:16:3e:ab:be:4a'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='tap7e5074e8-0f'/>
Nov 14 11:09:57 user nova-compute[75255]:       <model type='virtio'/>
Nov 14 11:09:57 user nova-compute[75255]:       <mtu size='1442'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='net0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </interface>
Nov 14 11:09:57 user nova-compute[75255]:     <serial type='pty'>
Nov 14 11:09:57 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:57 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target type='isa-serial' port='0'>
Nov 14 11:09:57 user nova-compute[75255]:         <model name='isa-serial'/>
Nov 14 11:09:57 user nova-compute[75255]:       </target>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </serial>
Nov 14 11:09:57 user nova-compute[75255]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 11:09:57 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:57 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target type='serial' port='0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </console>
Nov 14 11:09:57 user nova-compute[75255]:     <input type='mouse' bus='ps2'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='input0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </input>
Nov 14 11:09:57 user nova-compute[75255]:     <input type='keyboard' bus='ps2'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='input1'/>
Nov 14 11:09:57 user nova-compute[75255]:     </input>
Nov 14 11:09:57 user nova-compute[75255]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 11:09:57 user nova-compute[75255]:       <listen type='address' address='0.0.0.0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </graphics>
Nov 14 11:09:57 user nova-compute[75255]:     <audio id='1' type='none'/>
Nov 14 11:09:57 user nova-compute[75255]:     <video>
Nov 14 11:09:57 user nova-compute[75255]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='video0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </video>
Nov 14 11:09:57 user nova-compute[75255]:     <memballoon model='virtio'>
Nov 14 11:09:57 user nova-compute[75255]:       <stats period='10'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='balloon0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </memballoon>
Nov 14 11:09:57 user nova-compute[75255]:     <rng model='virtio'>
Nov 14 11:09:57 user nova-compute[75255]:       <backend model='random'>/dev/urandom</backend>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='rng0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </rng>
Nov 14 11:09:57 user nova-compute[75255]:   </devices>
Nov 14 11:09:57 user nova-compute[75255]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 11:09:57 user nova-compute[75255]:     <label>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</label>
Nov 14 11:09:57 user nova-compute[75255]:     <imagelabel>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</imagelabel>
Nov 14 11:09:57 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:57 user nova-compute[75255]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 11:09:57 user nova-compute[75255]:     <label>+64055:+108</label>
Nov 14 11:09:57 user nova-compute[75255]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 11:09:57 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:57 user nova-compute[75255]: </domain>
Nov 14 11:09:57 user nova-compute[75255]:  {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface> {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:f8:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tap7163a946-36"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 11:09:57 user nova-compute[75255]:   <name>instance-00000008</name>
Nov 14 11:09:57 user nova-compute[75255]:   <uuid>d7f63547-b356-471b-825d-6a0b4670221d</uuid>
Nov 14 11:09:57 user nova-compute[75255]:   <metadata>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:57 user nova-compute[75255]:   <nova:package version="0.0.0"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:creationTime>2023-11-14 11:09:57</nova:creationTime>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:flavor name="m1.tiny">
Nov 14 11:09:57 user nova-compute[75255]:     <nova:memory>512</nova:memory>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:disk>1</nova:disk>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:swap>0</nova:swap>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:flavor>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:ports>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:09:57 user nova-compute[75255]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:09:57 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:ports>
Nov 14 11:09:57 user nova-compute[75255]: </nova:instance>
Nov 14 11:09:57 user nova-compute[75255]:   </metadata>
Nov 14 11:09:57 user nova-compute[75255]:   <memory unit='KiB'>524288</memory>
Nov 14 11:09:57 user nova-compute[75255]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 11:09:57 user nova-compute[75255]:   <vcpu placement='static'>1</vcpu>
Nov 14 11:09:57 user nova-compute[75255]:   <resource>
Nov 14 11:09:57 user nova-compute[75255]:     <partition>/machine</partition>
Nov 14 11:09:57 user nova-compute[75255]:   </resource>
Nov 14 11:09:57 user nova-compute[75255]:   <sysinfo type='smbios'>
Nov 14 11:09:57 user nova-compute[75255]:     <system>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='version'>0.0.0</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='serial'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='uuid'>d7f63547-b356-471b-825d-6a0b4670221d</entry>
Nov 14 11:09:57 user nova-compute[75255]:       <entry name='family'>Virtual Machine</entry>
Nov 14 11:09:57 user nova-compute[75255]:     </system>
Nov 14 11:09:57 user nova-compute[75255]:   </sysinfo>
Nov 14 11:09:57 user nova-compute[75255]:   <os>
Nov 14 11:09:57 user nova-compute[75255]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 11:09:57 user nova-compute[75255]:     <boot dev='hd'/>
Nov 14 11:09:57 user nova-compute[75255]:     <smbios mode='sysinfo'/>
Nov 14 11:09:57 user nova-compute[75255]:   </os>
Nov 14 11:09:57 user nova-compute[75255]:   <features>
Nov 14 11:09:57 user nova-compute[75255]:     <acpi/>
Nov 14 11:09:57 user nova-compute[75255]:     <apic/>
Nov 14 11:09:57 user nova-compute[75255]:     <vmcoreinfo state='on'/>
Nov 14 11:09:57 user nova-compute[75255]:   </features>
Nov 14 11:09:57 user nova-compute[75255]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 11:09:57 user nova-compute[75255]:     <model fallback='forbid'>Nehalem</model>
Nov 14 11:09:57 user nova-compute[75255]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='vme'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='x2apic'/>
Nov 14 11:09:57 user nova-compute[75255]:     <feature policy='require' name='hypervisor'/>
Nov 14 11:09:57 user nova-compute[75255]:   </cpu>
Nov 14 11:09:57 user nova-compute[75255]:   <clock offset='utc'>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 11:09:57 user nova-compute[75255]:     <timer name='hpet' present='no'/>
Nov 14 11:09:57 user nova-compute[75255]:   </clock>
Nov 14 11:09:57 user nova-compute[75255]:   <on_poweroff>destroy</on_poweroff>
Nov 14 11:09:57 user nova-compute[75255]:   <on_reboot>restart</on_reboot>
Nov 14 11:09:57 user nova-compute[75255]:   <on_crash>destroy</on_crash>
Nov 14 11:09:57 user nova-compute[75255]:   <devices>
Nov 14 11:09:57 user nova-compute[75255]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 11:09:57 user nova-compute[75255]:     <disk type='file' device='disk'>
Nov 14 11:09:57 user nova-compute[75255]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 11:09:57 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk' index='2'/>
Nov 14 11:09:57 user nova-compute[75255]:       <backingStore type='file' index='3'>
Nov 14 11:09:57 user nova-compute[75255]:         <format type='raw'/>
Nov 14 11:09:57 user nova-compute[75255]:         <source file='/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96'/>
Nov 14 11:09:57 user nova-compute[75255]:         <backingStore/>
Nov 14 11:09:57 user nova-compute[75255]:       </backingStore>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='vda' bus='virtio'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='virtio-disk0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </disk>
Nov 14 11:09:57 user nova-compute[75255]:     <disk type='file' device='cdrom'>
Nov 14 11:09:57 user nova-compute[75255]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 11:09:57 user nova-compute[75255]:       <source file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk.config' index='1'/>
Nov 14 11:09:57 user nova-compute[75255]:       <backingStore/>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='hda' bus='ide'/>
Nov 14 11:09:57 user nova-compute[75255]:       <readonly/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='ide0-0-0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </disk>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='usb' index='0' model='none'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='usb'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='pci.0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <controller type='ide' index='0'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='ide'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 11:09:57 user nova-compute[75255]:     </controller>
Nov 14 11:09:57 user nova-compute[75255]:     <interface type='ethernet'>
Nov 14 11:09:57 user nova-compute[75255]:       <mac address='fa:16:3e:ab:be:4a'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target dev='tap7e5074e8-0f'/>
Nov 14 11:09:57 user nova-compute[75255]:       <model type='virtio'/>
Nov 14 11:09:57 user nova-compute[75255]:       <mtu size='1442'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='net0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </interface>
Nov 14 11:09:57 user nova-compute[75255]:     <serial type='pty'>
Nov 14 11:09:57 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:57 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target type='isa-serial' port='0'>
Nov 14 11:09:57 user nova-compute[75255]:         <model name='isa-serial'/>
Nov 14 11:09:57 user nova-compute[75255]:       </target>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </serial>
Nov 14 11:09:57 user nova-compute[75255]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 11:09:57 user nova-compute[75255]:       <source path='/dev/pts/7'/>
Nov 14 11:09:57 user nova-compute[75255]:       <log file='/opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/console.log' append='off'/>
Nov 14 11:09:57 user nova-compute[75255]:       <target type='serial' port='0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='serial0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </console>
Nov 14 11:09:57 user nova-compute[75255]:     <input type='mouse' bus='ps2'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='input0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </input>
Nov 14 11:09:57 user nova-compute[75255]:     <input type='keyboard' bus='ps2'>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='input1'/>
Nov 14 11:09:57 user nova-compute[75255]:     </input>
Nov 14 11:09:57 user nova-compute[75255]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 11:09:57 user nova-compute[75255]:       <listen type='address' address='0.0.0.0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </graphics>
Nov 14 11:09:57 user nova-compute[75255]:     <audio id='1' type='none'/>
Nov 14 11:09:57 user nova-compute[75255]:     <video>
Nov 14 11:09:57 user nova-compute[75255]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='video0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </video>
Nov 14 11:09:57 user nova-compute[75255]:     <memballoon model='virtio'>
Nov 14 11:09:57 user nova-compute[75255]:       <stats period='10'/>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='balloon0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </memballoon>
Nov 14 11:09:57 user nova-compute[75255]:     <rng model='virtio'>
Nov 14 11:09:57 user nova-compute[75255]:       <backend model='random'>/dev/urandom</backend>
Nov 14 11:09:57 user nova-compute[75255]:       <alias name='rng0'/>
Nov 14 11:09:57 user nova-compute[75255]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 11:09:57 user nova-compute[75255]:     </rng>
Nov 14 11:09:57 user nova-compute[75255]:   </devices>
Nov 14 11:09:57 user nova-compute[75255]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 11:09:57 user nova-compute[75255]:     <label>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</label>
Nov 14 11:09:57 user nova-compute[75255]:     <imagelabel>libvirt-d7f63547-b356-471b-825d-6a0b4670221d</imagelabel>
Nov 14 11:09:57 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:57 user nova-compute[75255]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 11:09:57 user nova-compute[75255]:     <label>+64055:+108</label>
Nov 14 11:09:57 user nova-compute[75255]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 11:09:57 user nova-compute[75255]:   </seclabel>
Nov 14 11:09:57 user nova-compute[75255]: </domain>
Nov 14 11:09:57 user nova-compute[75255]:  {{(pid=75255) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 11:09:57 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Detaching interface fa:16:3e:74:f8:c7 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap7163a946-36' not found.
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Converting VIF {"id": "7163a946-368a-49f4-b31b-d318ec43eb76", "address": "fa:16:3e:74:f8:c7", "network": {"id": "e37a981b-17c2-494e-ae5c-0654f8aa19c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1931535886", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7163a946-36", "ovs_interfaceid": "7163a946-368a-49f4-b31b-d318ec43eb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG os_vif [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7163a946-36, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:09:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:09:57 user nova-compute[75255]: INFO os_vif [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:f8:c7,bridge_name='br-int',has_traffic_filtering=True,id=7163a946-368a-49f4-b31b-d318ec43eb76,network=Network(e37a981b-17c2-494e-ae5c-0654f8aa19c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7163a946-36')
Nov 14 11:09:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [req-dd409c70-f19d-4a21-8d88-8c221a0ffa92 req-6a318460-30b4-41dc-85ea-46f82c6c2d21 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:09:57 user nova-compute[75255]:   <nova:package version="0.0.0"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:name>tempest-device-tagging-server-1451268280</nova:name>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:creationTime>2023-11-14 11:09:57</nova:creationTime>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:flavor name="m1.tiny">
Nov 14 11:09:57 user nova-compute[75255]:     <nova:memory>512</nova:memory>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:disk>1</nova:disk>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:swap>0</nova:swap>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:vcpus>1</nova:vcpus>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:flavor>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:user uuid="131d5867bb7f4f3bad0889df1d1f52b3">tempest-TaggedAttachmentsTest-1951976248-project-member</nova:user>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:project uuid="d3d728ce7e654140995d4ab0e3c81b15">tempest-TaggedAttachmentsTest-1951976248</nova:project>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:owner>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:09:57 user nova-compute[75255]:   <nova:ports>
Nov 14 11:09:57 user nova-compute[75255]:     <nova:port uuid="7e5074e8-0f3b-4d4e-886d-b667c9ec37c9">
Nov 14 11:09:57 user nova-compute[75255]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:09:57 user nova-compute[75255]:     </nova:port>
Nov 14 11:09:57 user nova-compute[75255]:   </nova:ports>
Nov 14 11:09:57 user nova-compute[75255]: </nova:instance>
Nov 14 11:09:57 user nova-compute[75255]:  {{(pid=75255) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 11:09:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [{"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:09:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Releasing lock "refresh_cache-d7f63547-b356-471b-825d-6a0b4670221d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:09:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-55b8b10b-6970-4095-9a79-aee8fdc70954 tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "interface-d7f63547-b356-471b-825d-6a0b4670221d-7163a946-368a-49f4-b31b-d318ec43eb76" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.579s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:09:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:08 user nova-compute[75255]: INFO nova.compute.manager [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Terminating instance
Nov 14 11:10:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-c5c104fc-2f42-4d6e-b7e7-6e351c0bde87 req-acdd96fd-c576-4403-8c43-a382aea891d5 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-vif-unplugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c5c104fc-2f42-4d6e-b7e7-6e351c0bde87 req-acdd96fd-c576-4403-8c43-a382aea891d5 service nova] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c5c104fc-2f42-4d6e-b7e7-6e351c0bde87 req-acdd96fd-c576-4403-8c43-a382aea891d5 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c5c104fc-2f42-4d6e-b7e7-6e351c0bde87 req-acdd96fd-c576-4403-8c43-a382aea891d5 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-c5c104fc-2f42-4d6e-b7e7-6e351c0bde87 req-acdd96fd-c576-4403-8c43-a382aea891d5 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] No waiting events found dispatching network-vif-unplugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-c5c104fc-2f42-4d6e-b7e7-6e351c0bde87 req-acdd96fd-c576-4403-8c43-a382aea891d5 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-vif-unplugged-438aabcf-8c82-4604-a29b-fa5d012b879d for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:10:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Instance destroyed successfully.
Nov 14 11:10:09 user nova-compute[75255]: DEBUG nova.objects.instance [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lazy-loading 'resources' on Instance uuid 41aa15c1-08df-4bc5-907c-36790452a8af {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-994548043',display_name='tempest-VolumesAssistedSnapshotsTest-server-994548043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-994548043',id=9,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfiieOnhk+TkdK6HQDW3uzXl4qlxoCDsefMwv3ctlPF8IZqGpZxjgWb4wGY3jT42SNEnLW977OHmPQ2gRdrlceQFAJmidYeZ9S73SsHx1RJ6nMCpPtAfQ/UXVLjOFERYA==',key_name='tempest-keypair-1355363180',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cd85bbe9945438bbeb05dddc2699c90',ramdisk_id='',reservation_id='r-xlefamvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1968772865',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1968772865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce374c4f13b942f6975f9a0f48297e8e',uuid=41aa15c1-08df-4bc5-907c-36790452a8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Converting VIF {"id": "438aabcf-8c82-4604-a29b-fa5d012b879d", "address": "fa:16:3e:24:23:c0", "network": {"id": "bc8a8b7f-8112-406f-a729-95e316aed630", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1984636998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd85bbe9945438bbeb05dddc2699c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438aabcf-8c", "ovs_interfaceid": "438aabcf-8c82-4604-a29b-fa5d012b879d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:23:c0,bridge_name='br-int',has_traffic_filtering=True,id=438aabcf-8c82-4604-a29b-fa5d012b879d,network=Network(bc8a8b7f-8112-406f-a729-95e316aed630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438aabcf-8c') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG os_vif [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:23:c0,bridge_name='br-int',has_traffic_filtering=True,id=438aabcf-8c82-4604-a29b-fa5d012b879d,network=Network(bc8a8b7f-8112-406f-a729-95e316aed630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438aabcf-8c') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap438aabcf-8c, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91222435-88c6-4754-9f91-0593c862fea4) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:10:09 user nova-compute[75255]: INFO os_vif [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:23:c0,bridge_name='br-int',has_traffic_filtering=True,id=438aabcf-8c82-4604-a29b-fa5d012b879d,network=Network(bc8a8b7f-8112-406f-a729-95e316aed630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438aabcf-8c')
Nov 14 11:10:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Deleting instance files /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af_del
Nov 14 11:10:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Deletion of /opt/stack/data/nova/instances/41aa15c1-08df-4bc5-907c-36790452a8af_del complete
Nov 14 11:10:09 user nova-compute[75255]: INFO nova.compute.manager [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 11:10:09 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:10:09 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:10 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Took 0.67 seconds to deallocate network for instance.
Nov 14 11:10:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:10 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Deleted allocations for instance 41aa15c1-08df-4bc5-907c-36790452a8af
Nov 14 11:10:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-297e8f56-d833-4fed-8665-9cbe521ef8d8 tempest-VolumesAssistedSnapshotsTest-1968772865 tempest-VolumesAssistedSnapshotsTest-1968772865-project-member] Lock "41aa15c1-08df-4bc5-907c-36790452a8af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.112s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-6983817a-df34-4b09-97a9-68df40e4a590 req-753a23fb-042e-4d0d-aab9-03bcb6eb7084 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6983817a-df34-4b09-97a9-68df40e4a590 req-753a23fb-042e-4d0d-aab9-03bcb6eb7084 service nova] Acquiring lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6983817a-df34-4b09-97a9-68df40e4a590 req-753a23fb-042e-4d0d-aab9-03bcb6eb7084 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6983817a-df34-4b09-97a9-68df40e4a590 req-753a23fb-042e-4d0d-aab9-03bcb6eb7084 service nova] Lock "41aa15c1-08df-4bc5-907c-36790452a8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-6983817a-df34-4b09-97a9-68df40e4a590 req-753a23fb-042e-4d0d-aab9-03bcb6eb7084 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] No waiting events found dispatching network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:10 user nova-compute[75255]: WARNING nova.compute.manager [req-6983817a-df34-4b09-97a9-68df40e4a590 req-753a23fb-042e-4d0d-aab9-03bcb6eb7084 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received unexpected event network-vif-plugged-438aabcf-8c82-4604-a29b-fa5d012b879d for instance with vm_state deleted and task_state None.
Nov 14 11:10:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-6983817a-df34-4b09-97a9-68df40e4a590 req-753a23fb-042e-4d0d-aab9-03bcb6eb7084 service nova] [instance: 41aa15c1-08df-4bc5-907c-36790452a8af] Received event network-vif-deleted-438aabcf-8c82-4604-a29b-fa5d012b879d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:11 user nova-compute[75255]: INFO nova.compute.manager [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Terminating instance
Nov 14 11:10:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-b3c5a9cd-fbe4-49ff-a0fc-0814b9f51e71 req-4f5f4c72-5842-49b0-89f9-8eb7f7536d66 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-vif-unplugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b3c5a9cd-fbe4-49ff-a0fc-0814b9f51e71 req-4f5f4c72-5842-49b0-89f9-8eb7f7536d66 service nova] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b3c5a9cd-fbe4-49ff-a0fc-0814b9f51e71 req-4f5f4c72-5842-49b0-89f9-8eb7f7536d66 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b3c5a9cd-fbe4-49ff-a0fc-0814b9f51e71 req-4f5f4c72-5842-49b0-89f9-8eb7f7536d66 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-b3c5a9cd-fbe4-49ff-a0fc-0814b9f51e71 req-4f5f4c72-5842-49b0-89f9-8eb7f7536d66 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] No waiting events found dispatching network-vif-unplugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-b3c5a9cd-fbe4-49ff-a0fc-0814b9f51e71 req-4f5f4c72-5842-49b0-89f9-8eb7f7536d66 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-vif-unplugged-6deed208-a0e2-42d2-9f6d-60ca090458bb for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:10:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Instance destroyed successfully.
Nov 14 11:10:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lazy-loading 'resources' on Instance uuid 2ce264fc-cc38-421a-92ae-41dc6174745d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-303193',display_name='tempest-TestVolumeSwap-server-303193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-303193',id=6,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHuw08HSgbQdJbR2bf2HTFdjMAhff4Od98+9uEGRXt6y9b0MBNpM90xQuKmbH3eybqUN1QDmECd7zC0RQ3K9QIxSezb1GxTDJT2Tkdm2bJbgEsU4aqWrBe4Nu3sd3ELFQ==',key_name='tempest-keypair-789578368',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d4f81e6ced34a3fa8853b6d98ad6c67',ramdisk_id='',reservation_id='r-z0ggo2i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1121882356',owner_user_name='tempest-TestVolumeSwap-1121882356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ae2b32e6784b6faeb59736a1cac40b',uuid=2ce264fc-cc38-421a-92ae-41dc6174745d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Converting VIF {"id": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "address": "fa:16:3e:2f:e3:61", "network": {"id": "bdf36771-acc3-4124-b771-ab7404f929f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-932904825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d4f81e6ced34a3fa8853b6d98ad6c67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6deed208-a0", "ovs_interfaceid": "6deed208-a0e2-42d2-9f6d-60ca090458bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e3:61,bridge_name='br-int',has_traffic_filtering=True,id=6deed208-a0e2-42d2-9f6d-60ca090458bb,network=Network(bdf36771-acc3-4124-b771-ab7404f929f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6deed208-a0') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG os_vif [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e3:61,bridge_name='br-int',has_traffic_filtering=True,id=6deed208-a0e2-42d2-9f6d-60ca090458bb,network=Network(bdf36771-acc3-4124-b771-ab7404f929f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6deed208-a0') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6deed208-a0, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=336aa7ed-ea38-466e-8f02-6ee2c587b9b7) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:12 user nova-compute[75255]: INFO os_vif [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e3:61,bridge_name='br-int',has_traffic_filtering=True,id=6deed208-a0e2-42d2-9f6d-60ca090458bb,network=Network(bdf36771-acc3-4124-b771-ab7404f929f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6deed208-a0')
Nov 14 11:10:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Deleting instance files /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d_del
Nov 14 11:10:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Deletion of /opt/stack/data/nova/instances/2ce264fc-cc38-421a-92ae-41dc6174745d_del complete
Nov 14 11:10:12 user nova-compute[75255]: INFO nova.compute.manager [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 14 11:10:12 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lazy-loading 'flavor' on Instance uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:10:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:13 user nova-compute[75255]: INFO nova.compute.manager [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Attaching volume 4655b965-55d1-4c75-af86-8a8caabfe655 to /dev/vdb
Nov 14 11:10:13 user nova-compute[75255]: DEBUG os_brick.utils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[325fbebd-12c2-49d1-a6c6-ed38a25cc2a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9754402-d745-42d3-86ad-6f6912bba27c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5f3b4-6995-4e7e-b688-12ee0fd4a92c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67a6bb-e111-4515-929b-ab43a48258bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:10:13 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c41fa-6fb3-4a96-923b-e31a2a1244d9]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG os_brick.utils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating existing volume attachment record: c562079c-03fb-4dad-92d1-a0b7f430e066 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:13 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Took 1.07 seconds to deallocate network for instance.
Nov 14 11:10:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-d0790c29-29f3-40d3-be14-8f21bd7a519d req-d7f91842-eb53-4431-8670-ad43b6c328b6 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-vif-deleted-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:13 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Deleted allocations for instance 2ce264fc-cc38-421a-92ae-41dc6174745d
Nov 14 11:10:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-fb90f08d-3f5d-4986-a787-eeeecc7b2a91 req-876e1722-a904-4e5d-ba23-3a2787e20aa0 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received event network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fb90f08d-3f5d-4986-a787-eeeecc7b2a91 req-876e1722-a904-4e5d-ba23-3a2787e20aa0 service nova] Acquiring lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fb90f08d-3f5d-4986-a787-eeeecc7b2a91 req-876e1722-a904-4e5d-ba23-3a2787e20aa0 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fb90f08d-3f5d-4986-a787-eeeecc7b2a91 req-876e1722-a904-4e5d-ba23-3a2787e20aa0 service nova] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-fb90f08d-3f5d-4986-a787-eeeecc7b2a91 req-876e1722-a904-4e5d-ba23-3a2787e20aa0 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] No waiting events found dispatching network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:14 user nova-compute[75255]: WARNING nova.compute.manager [req-fb90f08d-3f5d-4986-a787-eeeecc7b2a91 req-876e1722-a904-4e5d-ba23-3a2787e20aa0 service nova] [instance: 2ce264fc-cc38-421a-92ae-41dc6174745d] Received unexpected event network-vif-plugged-6deed208-a0e2-42d2-9f6d-60ca090458bb for instance with vm_state deleted and task_state None.
Nov 14 11:10:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3719c94d-2548-45a0-85bb-8456667bd370 tempest-TestVolumeSwap-1121882356 tempest-TestVolumeSwap-1121882356-project-member] Lock "2ce264fc-cc38-421a-92ae-41dc6174745d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:10:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:10:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:10:17 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c194ddb4-e203-4359-b23e-ec5634982504]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:10:17 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec16445-83b3-4e7d-b402-ce38774eaaf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655] added
Nov 14 11:10:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03feb3-301c-4de3-92be-42e879677807]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e6dab8-92df-4744-800b-9390f74ef91e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXFtywBY {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXFtywBY" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f838e0be-23d2-4778-9355-574eaa3ca4d6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXFtywBY'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[459291ac-f7a1-4a4c-899c-df676f9d4f97]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ee4cb-0e83-4526-84c3-1a4c74520a46]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc15106-100c-44ea-9eea-7b5c6fc74424]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]
Nov 14 11:10:17 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.
Nov 14 11:10:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[387c52b2-e41f-477a-b403-deb0a11a13d1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d9f88-cc73-4073-b650-c64d9cb36b5c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:17 user nova-compute[75255]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:10:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:17 user nova-compute[75255]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:10:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff9966-85e9-4aa7-868b-abb78657447e]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:10:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:10:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:10:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26139306333326364', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:10:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139306333326364', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:10:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lazy-loading 'flavor' on Instance uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:10:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:10:18 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:10:18 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:10:18 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:10:18 user nova-compute[75255]:   <serial>4655b965-55d1-4c75-af86-8a8caabfe655</serial>
Nov 14 11:10:18 user nova-compute[75255]: </disk>
Nov 14 11:10:18 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:10:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:10:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:10:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No VIF found with MAC fa:16:3e:47:a1:19, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:10:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2654e66f-0e4b-4836-bfbb-8e794f2f4f91 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.315s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Stashing vm_state: active {{(pid=75255) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 11:10:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:10:21 user nova-compute[75255]: INFO nova.compute.claims [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Claim successful on node user
Nov 14 11:10:21 user nova-compute[75255]: INFO nova.compute.resource_tracker [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating resource usage from migration f25766aa-a2ee-4894-9983-8a2721132a98
Nov 14 11:10:21 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:21 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.495s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:21 user nova-compute[75255]: INFO nova.compute.manager [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Migrating
Nov 14 11:10:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:10:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:10:21 user nova-compute[75255]: INFO nova.compute.rpcapi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 11:10:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:10:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:10:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:10:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG nova.network.neutron [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Starting migrate_disk_and_power_off {{(pid=75255) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-682f0d47-add0-4196-be06-a480872e5331 req-692f867e-5a99-419b-b68a-fe62408730e1 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-682f0d47-add0-4196-be06-a480872e5331 req-692f867e-5a99-419b-b68a-fe62408730e1 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-682f0d47-add0-4196-be06-a480872e5331 req-692f867e-5a99-419b-b68a-fe62408730e1 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-682f0d47-add0-4196-be06-a480872e5331 req-692f867e-5a99-419b-b68a-fe62408730e1 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-682f0d47-add0-4196-be06-a480872e5331 req-692f867e-5a99-419b-b68a-fe62408730e1 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:23 user nova-compute[75255]: WARNING nova.compute.manager [req-682f0d47-add0-4196-be06-a480872e5331 req-692f867e-5a99-419b-b68a-fe62408730e1 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state active and task_state resize_migrating.
Nov 14 11:10:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance destroyed successfully.
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2010252972-network", "vif_mac": "fa:16:3e:47:a1:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2010252972-network", "vif_mac": "fa:16:3e:47:a1:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_vif [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8730dcdf-d2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92b1338c-688e-4c7c-9d67-e49127c2db2a) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:23 user nova-compute[75255]: INFO os_vif [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2')
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:10:23 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4747e445-2f04-4bfa-9696-09934e2a7378]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:10:23 user nova-compute[75255]: No targets found.
Nov 14 11:10:23 user nova-compute[75255]: iSNS:
Nov 14 11:10:23 user nova-compute[75255]: No targets found.
Nov 14 11:10:23 user nova-compute[75255]: STATIC:
Nov 14 11:10:23 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:10:23 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:10:23 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:10:23 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:10:23 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:10:23 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:10:23 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:10:23 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:10:23 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:10:23 user nova-compute[75255]: FIRMWARE:
Nov 14 11:10:23 user nova-compute[75255]: No targets found.
Nov 14 11:10:23 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:10:23 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:10:23 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1752aa93-51f6-4f0f-a56b-15e6887227ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00e4f0e-d8e9-48dc-abef-90bff31624c1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:23 user nova-compute[75255]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:10:23 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:23 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:23 user nova-compute[75255]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:10:23 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:23 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3384125f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6811d5c8-2556-4f8e-a1a6-7e8ea324b02e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01ffe7a-bb1b-4edc-b45f-11b85e3f3966]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b4215b-6fd8-496c-8cc2-7e7bf2d11d84]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c95f0e0-22c4-40cf-9209-0863f85463e1]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93c841-5419-405d-bca7-b5ec5b4bdec5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf270d5-f953-4c72-99bc-f138db1415cd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]
Nov 14 11:10:23 user nova-compute[75255]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.
Nov 14 11:10:23 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[23065789-f6c1-4f54-b77f-7a0c6c731142]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== disconnect_volume: return (357ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:23 user nova-compute[75255]: INFO nova.compute.manager [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Terminating instance
Nov 14 11:10:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c_resize/disk /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-7f708e9c-520e-400e-8536-d0fd9ec1a939 req-a1748b26-3a03-4683-b902-c29d52a1261a service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-vif-unplugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7f708e9c-520e-400e-8536-d0fd9ec1a939 req-a1748b26-3a03-4683-b902-c29d52a1261a service nova] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7f708e9c-520e-400e-8536-d0fd9ec1a939 req-a1748b26-3a03-4683-b902-c29d52a1261a service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7f708e9c-520e-400e-8536-d0fd9ec1a939 req-a1748b26-3a03-4683-b902-c29d52a1261a service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-7f708e9c-520e-400e-8536-d0fd9ec1a939 req-a1748b26-3a03-4683-b902-c29d52a1261a service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] No waiting events found dispatching network-vif-unplugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-7f708e9c-520e-400e-8536-d0fd9ec1a939 req-a1748b26-3a03-4683-b902-c29d52a1261a service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-vif-unplugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Instance destroyed successfully.
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lazy-loading 'resources' on Instance uuid 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695545729',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695545729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1695545',id=11,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnORozttTzsSGpCeBLm+tK5XkeAFW3iBiYed5/wu3T7bYBI4GHF16kyhW0ccGW2/IVrMEX46UYAEBCQnaYPqkRhZVLG5PKVUY4BWEbvuTW9NaV9ouZ38tHXg7+hXOFx3g==',key_name='tempest-keypair-1580192274',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13439f3ceb84c0ebecc39beabbfb147',ramdisk_id='',reservation_id='r-ob8mi06u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1234251449',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78dd6817bd04c3b9a6b5111a374291e',uuid=71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Converting VIF {"id": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "address": "fa:16:3e:8c:71:a4", "network": {"id": "5caf9330-fb73-4c61-bb18-6b6be5f7af8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1263104204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13439f3ceb84c0ebecc39beabbfb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea464f49-6b", "ovs_interfaceid": "ea464f49-6b78-450d-9b10-124c0e2a31d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:71:a4,bridge_name='br-int',has_traffic_filtering=True,id=ea464f49-6b78-450d-9b10-124c0e2a31d7,network=Network(5caf9330-fb73-4c61-bb18-6b6be5f7af8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea464f49-6b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG os_vif [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:71:a4,bridge_name='br-int',has_traffic_filtering=True,id=ea464f49-6b78-450d-9b10-124c0e2a31d7,network=Network(5caf9330-fb73-4c61-bb18-6b6be5f7af8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea464f49-6b') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "cp -r /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c_resize/disk /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk" returned: 0 in 0.732s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c_resize/disk.info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk.info {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea464f49-6b, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "cp -r /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c_resize/disk.info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk.info" returned: 0 in 0.043s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de166419-f404-42c0-8109-834b9eff8e51) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:24 user nova-compute[75255]: INFO os_vif [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:71:a4,bridge_name='br-int',has_traffic_filtering=True,id=ea464f49-6b78-450d-9b10-124c0e2a31d7,network=Network(5caf9330-fb73-4c61-bb18-6b6be5f7af8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea464f49-6b')
Nov 14 11:10:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Deleting instance files /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2_del
Nov 14 11:10:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Deletion of /opt/stack/data/nova/instances/71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2_del complete
Nov 14 11:10:24 user nova-compute[75255]: INFO nova.compute.manager [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 11:10:24 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:10:24 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-eeba7e4e-00b9-4bda-940b-33cf34113d0d req-79ec46f0-e71a-444e-890e-6cc7f3875db0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-eeba7e4e-00b9-4bda-940b-33cf34113d0d req-79ec46f0-e71a-444e-890e-6cc7f3875db0 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-eeba7e4e-00b9-4bda-940b-33cf34113d0d req-79ec46f0-e71a-444e-890e-6cc7f3875db0 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-eeba7e4e-00b9-4bda-940b-33cf34113d0d req-79ec46f0-e71a-444e-890e-6cc7f3875db0 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-eeba7e4e-00b9-4bda-940b-33cf34113d0d req-79ec46f0-e71a-444e-890e-6cc7f3875db0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:25 user nova-compute[75255]: WARNING nova.compute.manager [req-eeba7e4e-00b9-4bda-940b-33cf34113d0d req-79ec46f0-e71a-444e-890e-6cc7f3875db0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state active and task_state resize_migrating.
Nov 14 11:10:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Port 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf binding to destination host user is already ACTIVE {{(pid=75255) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-3ae5fb60-e89c-4929-a550-d3e83b35debc req-87b6407d-62c2-4596-b949-7d8b3ab5e5ad service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3ae5fb60-e89c-4929-a550-d3e83b35debc req-87b6407d-62c2-4596-b949-7d8b3ab5e5ad service nova] Acquiring lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3ae5fb60-e89c-4929-a550-d3e83b35debc req-87b6407d-62c2-4596-b949-7d8b3ab5e5ad service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3ae5fb60-e89c-4929-a550-d3e83b35debc req-87b6407d-62c2-4596-b949-7d8b3ab5e5ad service nova] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-3ae5fb60-e89c-4929-a550-d3e83b35debc req-87b6407d-62c2-4596-b949-7d8b3ab5e5ad service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] No waiting events found dispatching network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:26 user nova-compute[75255]: WARNING nova.compute.manager [req-3ae5fb60-e89c-4929-a550-d3e83b35debc req-87b6407d-62c2-4596-b949-7d8b3ab5e5ad service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received unexpected event network-vif-plugged-ea464f49-6b78-450d-9b10-124c0e2a31d7 for instance with vm_state active and task_state deleting.
Nov 14 11:10:26 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:26 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Took 1.74 seconds to deallocate network for instance.
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG os_brick.utils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:10:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa93703-f85a-439b-9cfb-660efd7425f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd540be-7880-4fb7-b9be-6c905cff4d98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[56709fab-1585-4f20-97c0-d6c6eb52d5ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4220e822-b406-4ea8-96e2-3bcd6b3ae02b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:10:27 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd9c101-0fa1-44e5-9d19-ba63f71d04ac]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG os_brick.utils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.249s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:10:27 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Deleted allocations for instance 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d6596bf5-34d4-4f71-b789-3bde758339d3 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449 tempest-TestServerVolumeAttachScenarioOldVersion-1234251449-project-member] Lock "71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.455s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:27 user nova-compute[75255]: INFO nova.compute.manager [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Terminating instance
Nov 14 11:10:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-d2460256-415f-4d14-a56f-7bef05fc2e2b req-920c1b61-9d27-4486-bd06-3d82413747a3 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-unplugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d2460256-415f-4d14-a56f-7bef05fc2e2b req-920c1b61-9d27-4486-bd06-3d82413747a3 service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d2460256-415f-4d14-a56f-7bef05fc2e2b req-920c1b61-9d27-4486-bd06-3d82413747a3 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d2460256-415f-4d14-a56f-7bef05fc2e2b req-920c1b61-9d27-4486-bd06-3d82413747a3 service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-d2460256-415f-4d14-a56f-7bef05fc2e2b req-920c1b61-9d27-4486-bd06-3d82413747a3 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-unplugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-d2460256-415f-4d14-a56f-7bef05fc2e2b req-920c1b61-9d27-4486-bd06-3d82413747a3 service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-unplugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Instance destroyed successfully.
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.objects.instance [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lazy-loading 'resources' on Instance uuid d7f63547-b356-471b-825d-6a0b4670221d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1451268280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1451268280',id=8,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH8C4+xwBkghtgmrC3HYai2vnpNC33JGFMLnF5H8nCZx2zgDTKKFKBFqMqmaqGxCtsDuSxI/wfLcQY1z6ufzobxMkYBhABXiET4a5NEu+WK06fllTQvYQN/HIuR8T+r7w==',key_name='tempest-keypair-63663701',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3d728ce7e654140995d4ab0e3c81b15',ramdisk_id='',reservation_id='r-0ylffn5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1951976248',owner_user_name='tempest-TaggedAttachmentsTest-1951976248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='131d5867bb7f4f3bad0889df1d1f52b3',uuid=d7f63547-b356-471b-825d-6a0b4670221d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converting VIF {"id": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "address": "fa:16:3e:ab:be:4a", "network": {"id": "21bb0e83-7000-4a7e-b982-38a074591b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-707990132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d728ce7e654140995d4ab0e3c81b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5074e8-0f", "ovs_interfaceid": "7e5074e8-0f3b-4d4e-886d-b667c9ec37c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:be:4a,bridge_name='br-int',has_traffic_filtering=True,id=7e5074e8-0f3b-4d4e-886d-b667c9ec37c9,network=Network(21bb0e83-7000-4a7e-b982-38a074591b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5074e8-0f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG os_vif [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:be:4a,bridge_name='br-int',has_traffic_filtering=True,id=7e5074e8-0f3b-4d4e-886d-b667c9ec37c9,network=Network(21bb0e83-7000-4a7e-b982-38a074591b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5074e8-0f') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e5074e8-0f, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54bed34f-726e-46f0-9e37-f7ca71250012) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:28 user nova-compute[75255]: INFO os_vif [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:be:4a,bridge_name='br-int',has_traffic_filtering=True,id=7e5074e8-0f3b-4d4e-886d-b667c9ec37c9,network=Network(21bb0e83-7000-4a7e-b982-38a074591b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5074e8-0f')
Nov 14 11:10:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Deleting instance files /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d_del
Nov 14 11:10:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Deletion of /opt/stack/data/nova/instances/d7f63547-b356-471b-825d-6a0b4670221d_del complete
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-ed444a1d-a922-47dd-936b-fd8d276a40ee req-7ec406ca-472c-4dff-b4cc-95fb5ac81bd4 service nova] [instance: 71f2ef8c-96d8-4f1a-9b10-e2e4c06116a2] Received event network-vif-deleted-ea464f49-6b78-450d-9b10-124c0e2a31d7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:28 user nova-compute[75255]: INFO nova.compute.manager [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: d7f63547-b356-471b-825d-6a0b4670221d] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:10:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:29 user nova-compute[75255]: INFO nova.compute.manager [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Terminating instance
Nov 14 11:10:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:29 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Took 0.99 seconds to deallocate network for instance.
Nov 14 11:10:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7ab84bcb-f63a-4600-b61e-24b67ce12083 req-d2a28c4e-1201-413f-b29d-03a14dafe3cc service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-vif-unplugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ab84bcb-f63a-4600-b61e-24b67ce12083 req-d2a28c4e-1201-413f-b29d-03a14dafe3cc service nova] Acquiring lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ab84bcb-f63a-4600-b61e-24b67ce12083 req-d2a28c4e-1201-413f-b29d-03a14dafe3cc service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ab84bcb-f63a-4600-b61e-24b67ce12083 req-d2a28c4e-1201-413f-b29d-03a14dafe3cc service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7ab84bcb-f63a-4600-b61e-24b67ce12083 req-d2a28c4e-1201-413f-b29d-03a14dafe3cc service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] No waiting events found dispatching network-vif-unplugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-7ab84bcb-f63a-4600-b61e-24b67ce12083 req-d2a28c4e-1201-413f-b29d-03a14dafe3cc service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-vif-unplugged-da25fbae-506b-47a6-8de0-5325d33d4786 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Instance destroyed successfully.
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.objects.instance [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'resources' on Instance uuid 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2096020659',display_name='tempest-AttachVolumeNegativeTest-server-2096020659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2096020659',id=13,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3E5deyMQNOcoC9KTBBPamCfYZA4ChfP1pGUriXtUqSekQQ5/MKSwdTW1YFHuJA2OZmtMuCCMyLwl+qmvvxdaAvXHn4qRwYmwKeANgBkcmBM+0dY8lzN1uxZyIrPW87rA==',key_name='tempest-keypair-543350306',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-4t84mirh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=3d6a0be5-ad0d-4099-bacf-50c5bd2e521c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:22,bridge_name='br-int',has_traffic_filtering=True,id=da25fbae-506b-47a6-8de0-5325d33d4786,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda25fbae-50') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG os_vif [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:22,bridge_name='br-int',has_traffic_filtering=True,id=da25fbae-506b-47a6-8de0-5325d33d4786,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda25fbae-50') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda25fbae-50, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9f84b28-0058-4376-a247-1d3118ebba45) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:30 user nova-compute[75255]: INFO os_vif [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:22,bridge_name='br-int',has_traffic_filtering=True,id=da25fbae-506b-47a6-8de0-5325d33d4786,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda25fbae-50')
Nov 14 11:10:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Deleting instance files /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c_del
Nov 14 11:10:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Deletion of /opt/stack/data/nova/instances/3d6a0be5-ad0d-4099-bacf-50c5bd2e521c_del complete
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] Acquiring lock "d7f63547-b356-471b-825d-6a0b4670221d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] Lock "d7f63547-b356-471b-825d-6a0b4670221d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] No waiting events found dispatching network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:30 user nova-compute[75255]: WARNING nova.compute.manager [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received unexpected event network-vif-plugged-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 for instance with vm_state deleted and task_state None.
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-changed-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Refreshing instance network info cache due to event network-changed-da25fbae-506b-47a6-8de0-5325d33d4786. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] Acquiring lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] Acquired lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.network.neutron [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Refreshing network info cache for port da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:30 user nova-compute[75255]: INFO nova.compute.manager [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:30 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Deleted allocations for instance d7f63547-b356-471b-825d-6a0b4670221d
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-998b8a97-a481-4565-aae6-67e7a33bc32c tempest-TaggedAttachmentsTest-1951976248 tempest-TaggedAttachmentsTest-1951976248-project-member] Lock "d7f63547-b356-471b-825d-6a0b4670221d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.network.neutron [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Updated VIF entry in instance network info cache for port da25fbae-506b-47a6-8de0-5325d33d4786. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.network.neutron [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Updating instance_info_cache with network_info: [{"id": "da25fbae-506b-47a6-8de0-5325d33d4786", "address": "fa:16:3e:ec:26:22", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda25fbae-50", "ovs_interfaceid": "da25fbae-506b-47a6-8de0-5325d33d4786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] Releasing lock "refresh_cache-3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-212ea64c-14cd-4beb-85a9-42c05c9c2ef8 req-364be60d-829b-4a73-868d-ba1821cd6d6b service nova] [instance: d7f63547-b356-471b-825d-6a0b4670221d] Received event network-vif-deleted-7e5074e8-0f3b-4d4e-886d-b667c9ec37c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:30 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid '3d6a0be5-ad0d-4099-bacf-50c5bd2e521c' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid '3d6a0be5-ad0d-4099-bacf-50c5bd2e521c' (instance-0000000d)
Nov 14 11:10:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-b441b000-524e-4739-89d2-9258c7886de2 req-12a802ab-185f-4e30-b7f4-f6a8dd67a2db service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-vif-deleted-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:31 user nova-compute[75255]: INFO nova.compute.manager [req-b441b000-524e-4739-89d2-9258c7886de2 req-12a802ab-185f-4e30-b7f4-f6a8dd67a2db service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Neutron deleted interface da25fbae-506b-47a6-8de0-5325d33d4786; detaching it from the instance and deleting it from the info cache
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.network.neutron [req-b441b000-524e-4739-89d2-9258c7886de2 req-12a802ab-185f-4e30-b7f4-f6a8dd67a2db service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:31 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Took 0.79 seconds to deallocate network for instance.
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-b441b000-524e-4739-89d2-9258c7886de2 req-12a802ab-185f-4e30-b7f4-f6a8dd67a2db service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Detach interface failed, port_id=da25fbae-506b-47a6-8de0-5325d33d4786, reason: Instance 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:10:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7767MB free_disk=25.357391357421875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-a03805b2-eb00-4be6-a7fe-0065cf7e6faf req-bd2063ef-4a05-4696-8874-3e10fe790f93 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received event network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a03805b2-eb00-4be6-a7fe-0065cf7e6faf req-bd2063ef-4a05-4696-8874-3e10fe790f93 service nova] Acquiring lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a03805b2-eb00-4be6-a7fe-0065cf7e6faf req-bd2063ef-4a05-4696-8874-3e10fe790f93 service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a03805b2-eb00-4be6-a7fe-0065cf7e6faf req-bd2063ef-4a05-4696-8874-3e10fe790f93 service nova] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-a03805b2-eb00-4be6-a7fe-0065cf7e6faf req-bd2063ef-4a05-4696-8874-3e10fe790f93 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] No waiting events found dispatching network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:31 user nova-compute[75255]: WARNING nova.compute.manager [req-a03805b2-eb00-4be6-a7fe-0065cf7e6faf req-bd2063ef-4a05-4696-8874-3e10fe790f93 service nova] [instance: 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c] Received unexpected event network-vif-plugged-da25fbae-506b-47a6-8de0-5325d33d4786 for instance with vm_state deleted and task_state None.
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.814s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.142s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:31 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Deleted allocations for instance 3d6a0be5-ad0d-4099-bacf-50c5bd2e521c
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Applying migration context for instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c as it has an incoming, in-progress migration f25766aa-a2ee-4894-9983-8a2721132a98. Migration status is post-migrating {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 11:10:32 user nova-compute[75255]: INFO nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating resource usage from migration f25766aa-a2ee-4894-9983-8a2721132a98
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01bd7aa8-a786-4479-beb9-5ce9d384d075 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "3d6a0be5-ad0d-4099-bacf-50c5bd2e521c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.791s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2e186944-c41d-4f07-b852-ff17b2241241 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Migration f25766aa-a2ee-4894-9983-8a2721132a98 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Starting finish_migration {{(pid=75255) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:10:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Creating image(s)
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk. size=21474836480 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk 21474836480 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk 21474836480" returned: 0 in 0.239s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Ensure instance console log exists: /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Start _get_guest_xml network_info=[{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2010252972-network", "vif_mac": "fa:16:3e:47:a1:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '17702489-a781-499b-ac85-b9433dbfe830', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c', 'attached_at': '2023-11-14T11:10:32.000000', 'detached_at': '', 'volume_id': '4655b965-55d1-4c75-af86-8a8caabfe655', 'serial': '4655b965-55d1-4c75-af86-8a8caabfe655'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:10:33 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:10:33 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:10:33 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:10:33 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:10:33 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff3ea8-7773-484f-a017-c98386a7a2c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:10:33 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[864eb407-3523-4ee6-9e6d-50a60a1038de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655] added
Nov 14 11:10:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bfcfa1-2745-46be-9e72-6507fdd6cc02]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c82b59-cda1-4f1d-8d8c-3b84fa8d4a76]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXFtywBY {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXFtywBY" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8d3f96-8352-4e97-a00c-2d3b9b4e0751]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXFtywBY'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee27f28e-f54f-4d62-8c75-f0e037d38ffa]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce942384-6e7f-4b8c-9e58-40f55f2295ae]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:33 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:33 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a200196-e826-43a1-9490-bf6b94df4640]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]
Nov 14 11:10:33 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.
Nov 14 11:10:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4517e99-1ff0-4218-8888-7942d1b1d86d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c339ea-a6da-4eb3-8435-9c636e15f8c5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:33 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:10:33 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:10:33 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:10:33 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:10:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fe6179-d620-4c5f-8502-1a61ef8078f6]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26139306333326364', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139306333326364', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2010252972-network", "vif_mac": "fa:16:3e:47:a1:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2010252972-network", "vif_mac": "fa:16:3e:47:a1:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:10:34 user nova-compute[75255]:   <uuid>26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</uuid>
Nov 14 11:10:34 user nova-compute[75255]:   <name>instance-00000003</name>
Nov 14 11:10:34 user nova-compute[75255]:   <memory>2097152</memory>
Nov 14 11:10:34 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:10:34 user nova-compute[75255]:   <metadata>
Nov 14 11:10:34 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:10:34 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:10:34 user nova-compute[75255]:       <nova:name>tempest-ServerActionsTestOtherB-server-1199255564</nova:name>
Nov 14 11:10:34 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:10:33</nova:creationTime>
Nov 14 11:10:34 user nova-compute[75255]:       <nova:flavor name="m1.small">
Nov 14 11:10:34 user nova-compute[75255]:         <nova:memory>2048</nova:memory>
Nov 14 11:10:34 user nova-compute[75255]:         <nova:disk>20</nova:disk>
Nov 14 11:10:34 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:10:34 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:10:34 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:10:34 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:10:34 user nova-compute[75255]:       <nova:owner>
Nov 14 11:10:34 user nova-compute[75255]:         <nova:user uuid="a6cafcd6055544bcbd86f3015db594f2">tempest-ServerActionsTestOtherB-1009587932-project-member</nova:user>
Nov 14 11:10:34 user nova-compute[75255]:         <nova:project uuid="7b3a9d5daf4b497a8a85e435e91f1727">tempest-ServerActionsTestOtherB-1009587932</nova:project>
Nov 14 11:10:34 user nova-compute[75255]:       </nova:owner>
Nov 14 11:10:34 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:10:34 user nova-compute[75255]:       <nova:ports>
Nov 14 11:10:34 user nova-compute[75255]:         <nova:port uuid="8730dcdf-d2cb-4be1-aa6a-299cb1b955bf">
Nov 14 11:10:34 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:10:34 user nova-compute[75255]:         </nova:port>
Nov 14 11:10:34 user nova-compute[75255]:       </nova:ports>
Nov 14 11:10:34 user nova-compute[75255]:     </nova:instance>
Nov 14 11:10:34 user nova-compute[75255]:   </metadata>
Nov 14 11:10:34 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:10:34 user nova-compute[75255]:     <system>
Nov 14 11:10:34 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:10:34 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:10:34 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:10:34 user nova-compute[75255]:       <entry name="serial">26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</entry>
Nov 14 11:10:34 user nova-compute[75255]:       <entry name="uuid">26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</entry>
Nov 14 11:10:34 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:10:34 user nova-compute[75255]:     </system>
Nov 14 11:10:34 user nova-compute[75255]:   </sysinfo>
Nov 14 11:10:34 user nova-compute[75255]:   <os>
Nov 14 11:10:34 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:10:34 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:10:34 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:10:34 user nova-compute[75255]:   </os>
Nov 14 11:10:34 user nova-compute[75255]:   <features>
Nov 14 11:10:34 user nova-compute[75255]:     <acpi/>
Nov 14 11:10:34 user nova-compute[75255]:     <apic/>
Nov 14 11:10:34 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:10:34 user nova-compute[75255]:   </features>
Nov 14 11:10:34 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:10:34 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:10:34 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:10:34 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:10:34 user nova-compute[75255]:   </clock>
Nov 14 11:10:34 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:10:34 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:10:34 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:10:34 user nova-compute[75255]:   </cpu>
Nov 14 11:10:34 user nova-compute[75255]:   <devices>
Nov 14 11:10:34 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:10:34 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:10:34 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk"/>
Nov 14 11:10:34 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:10:34 user nova-compute[75255]:     </disk>
Nov 14 11:10:34 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:10:34 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:10:34 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:10:34 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:10:34 user nova-compute[75255]:       <serial>4655b965-55d1-4c75-af86-8a8caabfe655</serial>
Nov 14 11:10:34 user nova-compute[75255]:     </disk>
Nov 14 11:10:34 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:10:34 user nova-compute[75255]:       <mac address="fa:16:3e:47:a1:19"/>
Nov 14 11:10:34 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:10:34 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:10:34 user nova-compute[75255]:       <target dev="tap8730dcdf-d2"/>
Nov 14 11:10:34 user nova-compute[75255]:     </interface>
Nov 14 11:10:34 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:10:34 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/console.log" append="off"/>
Nov 14 11:10:34 user nova-compute[75255]:     </serial>
Nov 14 11:10:34 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:10:34 user nova-compute[75255]:     <video>
Nov 14 11:10:34 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:10:34 user nova-compute[75255]:     </video>
Nov 14 11:10:34 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:10:34 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:10:34 user nova-compute[75255]:     </rng>
Nov 14 11:10:34 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:10:34 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:10:34 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:10:34 user nova-compute[75255]:     </memballoon>
Nov 14 11:10:34 user nova-compute[75255]:   </devices>
Nov 14 11:10:34 user nova-compute[75255]: </domain>
Nov 14 11:10:34 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2010252972-network", "vif_mac": "fa:16:3e:47:a1:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2010252972-network", "vif_mac": "fa:16:3e:47:a1:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG os_vif [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac70d005-d2cb-57f9-84aa-74991961abd8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8730dcdf-d2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8730dcdf-d2, col_values=(('qos', UUID('0cf18306-2d31-4346-9ee4-16d12d2f6290')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8730dcdf-d2, col_values=(('external_ids', {'iface-id': '8730dcdf-d2cb-4be1-aa6a-299cb1b955bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:a1:19', 'vm-uuid': '26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:34 user nova-compute[75255]: INFO os_vif [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2')
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:10:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] No VIF found with MAC fa:16:3e:47:a1:19, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updating instance_info_cache with network_info: [{"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-f4ca2ee5-91e6-453a-80ea-8773d9cb4952 req-845f9116-860d-4d99-ab95-82f6e64c8521 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f4ca2ee5-91e6-453a-80ea-8773d9cb4952 req-845f9116-860d-4d99-ab95-82f6e64c8521 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f4ca2ee5-91e6-453a-80ea-8773d9cb4952 req-845f9116-860d-4d99-ab95-82f6e64c8521 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f4ca2ee5-91e6-453a-80ea-8773d9cb4952 req-845f9116-860d-4d99-ab95-82f6e64c8521 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-f4ca2ee5-91e6-453a-80ea-8773d9cb4952 req-845f9116-860d-4d99-ab95-82f6e64c8521 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:36 user nova-compute[75255]: WARNING nova.compute.manager [req-f4ca2ee5-91e6-453a-80ea-8773d9cb4952 req-845f9116-860d-4d99-ab95-82f6e64c8521 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state active and task_state resize_finish.
Nov 14 11:10:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:10:38 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance running successfully.
Nov 14 11:10:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Failed to set time: agent not configured {{(pid=75255) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 11:10:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-887cddf5-16cb-4033-9c7a-10d561f0619c tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] finish_migration finished successfully. {{(pid=75255) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 11:10:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-6ca99c1d-6074-46e3-8d00-0d48de34488b req-d743dacc-d4e7-453e-ad98-23b37dcb33e6 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:10:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6ca99c1d-6074-46e3-8d00-0d48de34488b req-d743dacc-d4e7-453e-ad98-23b37dcb33e6 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6ca99c1d-6074-46e3-8d00-0d48de34488b req-d743dacc-d4e7-453e-ad98-23b37dcb33e6 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6ca99c1d-6074-46e3-8d00-0d48de34488b req-d743dacc-d4e7-453e-ad98-23b37dcb33e6 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-6ca99c1d-6074-46e3-8d00-0d48de34488b req-d743dacc-d4e7-453e-ad98-23b37dcb33e6 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:10:38 user nova-compute[75255]: WARNING nova.compute.manager [req-6ca99c1d-6074-46e3-8d00-0d48de34488b req-d743dacc-d4e7-453e-ad98-23b37dcb33e6 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state resized and task_state None.
Nov 14 11:10:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:10:58 user nova-compute[75255]: INFO nova.compute.claims [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Claim successful on node user
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:10:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:10:58 user nova-compute[75255]: INFO nova.virt.block_device [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Booting with volume 8dd638b1-00a5-439f-9bbf-e68edde8f685 at /dev/vda
Nov 14 11:10:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.policy [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed1e0e782ec1411bae848a63a9e76c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ae70ce6a6c46a5a7558971f96ddf5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8f5412-5cdf-480d-aa34-b776ce3cdc19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d6ad9-85f2-491c-bf6f-723a6e6ae718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[030c5274-f2bb-4267-843a-ca638664b926]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d78b1d-6764-4044-bf1f-d573d77d7d5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:10:58 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:10:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d5e5a9-541a-4bd1-9407-8bab19bfc8d5]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:10:58 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating existing volume attachment record: 3a8ff274-1aa3-4878-92ab-469437faf4fe {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:10:59 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully created port: b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:10:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:10:59 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully created port: 4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:11:00 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully created port: 5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:11:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully created port: 9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:11:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:02 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully created port: 51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully updated port: b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-b809feb7-2144-4123-8de8-43451d6ec258. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG nova.network.neutron [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG nova.network.neutron [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG nova.network.neutron [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:03 user nova-compute[75255]: INFO nova.virt.block_device [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Booting with volume 2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f at /dev/vdb
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-678ebd1e-8a84-47e8-8016-0fcb494728ae req-3d06f9b5-9cdf-4b3c-a3ef-19e05c79081f service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG os_brick.utils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef06a8db-f333-455a-8c68-6598ed3a9617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[372b9358-748e-4495-838e-5350bdc00899]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcc5523-152a-4bc4-9fd4-d372059591cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2516e6-2cf0-42a3-ba08-33dddf91463f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:11:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:11:04 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:11:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c2985a-a9b8-44f4-b273-ead18f8092b1]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG os_brick.utils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating existing volume attachment record: 6c905346-5eed-4ecf-a2b4-0d7b07eef603 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully updated port: ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully updated port: 5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-ab2e7ac9-e023-4327-9b99-e33b65e1ffed. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully updated port: 4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-5ad47315-5fa1-4867-bb4b-087b246d1751. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port 5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:06 user nova-compute[75255]: DEBUG nova.network.neutron [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cbe286e3-4764-4746-a9be-81e1ae2bc5e5 req-2080f6e3-b83e-4b5e-8182-1c409063c49e service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully updated port: 5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port 4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully updated port: 9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-5578eb30-f8cc-4113-943f-ec533b734589. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port 5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:08 user nova-compute[75255]: INFO nova.compute.manager [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Rescuing
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-77446681-fd76-4f4b-aa3f-b010e7e270ae req-fbf676bc-3a7c-4188-b3fd-790dc1118b9c service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Successfully updated port: 51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: INFO nova.virt.block_device [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Booting with volume 61d6843d-811f-480d-8879-b58a37b22649 at /dev/vdc
Nov 14 11:11:09 user nova-compute[75255]: DEBUG os_brick.utils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b41ec3-15e7-41ee-9240-4ea045169b4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a378272-9a6f-4432-82bf-969a4ea1fe60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1076ba0-4c09-44a6-b4be-8e55cfabaf02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccca2a57-0ac8-4df5-b19b-880f767e32c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:11:09 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7975647f-ca96-4f02-af06-457108291dae]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG os_brick.utils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating existing volume attachment record: e0e97796-a45d-4adc-b662-b217e9be29e6 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-9e99fa23-783f-4c65-8a2b-4e62f2636047. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance destroyed successfully.
Nov 14 11:11:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Attempting rescue
Nov 14 11:11:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75255) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:11:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Creating image(s)
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'trusted_certs' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-9b2e08a6-daeb-4096-990d-bfeb92bc2d0c req-c4d8a575-511a-49a4-95cc-646ce716cc92 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9b2e08a6-daeb-4096-990d-bfeb92bc2d0c req-c4d8a575-511a-49a4-95cc-646ce716cc92 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9b2e08a6-daeb-4096-990d-bfeb92bc2d0c req-c4d8a575-511a-49a4-95cc-646ce716cc92 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9b2e08a6-daeb-4096-990d-bfeb92bc2d0c req-c4d8a575-511a-49a4-95cc-646ce716cc92 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-9b2e08a6-daeb-4096-990d-bfeb92bc2d0c req-c4d8a575-511a-49a4-95cc-646ce716cc92 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:10 user nova-compute[75255]: WARNING nova.compute.manager [req-9b2e08a6-daeb-4096-990d-bfeb92bc2d0c req-c4d8a575-511a-49a4-95cc-646ce716cc92 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.207s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue" returned: 0 in 0.065s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'migration_context' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.base [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<943d1e23-bb99-4499-83db-eca996c3fedf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Start _get_guest_xml network_info=[{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:f7:c9:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'resources' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.base [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<943d1e23-bb99-4499-83db-eca996c3fedf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'numa_topology' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.base [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<943d1e23-bb99-4499-83db-eca996c3fedf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:11:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'vcpu_model' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.base [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<943d1e23-bb99-4499-83db-eca996c3fedf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461046809',display_name='tempest-ServerRescueNegativeTestJSON-server-1461046809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461046809',id=1,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-yvdv1q6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:06:43Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=943d1e23-bb99-4499-83db-eca996c3fedf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:f7:c9:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:f7:c9:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'pci_devices' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.objects.base [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<943d1e23-bb99-4499-83db-eca996c3fedf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:11:10 user nova-compute[75255]:   <uuid>943d1e23-bb99-4499-83db-eca996c3fedf</uuid>
Nov 14 11:11:10 user nova-compute[75255]:   <name>instance-00000001</name>
Nov 14 11:11:10 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:11:10 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:11:10 user nova-compute[75255]:   <metadata>
Nov 14 11:11:10 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:11:10 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:11:10 user nova-compute[75255]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1461046809</nova:name>
Nov 14 11:11:10 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:11:10</nova:creationTime>
Nov 14 11:11:10 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:11:10 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:11:10 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:11:10 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:11:10 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:11:10 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:11:10 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:11:10 user nova-compute[75255]:       <nova:owner>
Nov 14 11:11:10 user nova-compute[75255]:         <nova:user uuid="13c7ed01376d41ac9b99ba698909e8bf">tempest-ServerRescueNegativeTestJSON-2135406154-project-member</nova:user>
Nov 14 11:11:10 user nova-compute[75255]:         <nova:project uuid="e4a3c374e68a4ec483ff0a15298b1bff">tempest-ServerRescueNegativeTestJSON-2135406154</nova:project>
Nov 14 11:11:10 user nova-compute[75255]:       </nova:owner>
Nov 14 11:11:10 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:11:10 user nova-compute[75255]:       <nova:ports>
Nov 14 11:11:10 user nova-compute[75255]:         <nova:port uuid="7853a5a2-5301-4337-a5a4-6bcddf944f11">
Nov 14 11:11:10 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:11:10 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:10 user nova-compute[75255]:       </nova:ports>
Nov 14 11:11:10 user nova-compute[75255]:     </nova:instance>
Nov 14 11:11:10 user nova-compute[75255]:   </metadata>
Nov 14 11:11:10 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:11:10 user nova-compute[75255]:     <system>
Nov 14 11:11:10 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:11:10 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:11:10 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:11:10 user nova-compute[75255]:       <entry name="serial">943d1e23-bb99-4499-83db-eca996c3fedf</entry>
Nov 14 11:11:10 user nova-compute[75255]:       <entry name="uuid">943d1e23-bb99-4499-83db-eca996c3fedf</entry>
Nov 14 11:11:10 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:11:10 user nova-compute[75255]:     </system>
Nov 14 11:11:10 user nova-compute[75255]:   </sysinfo>
Nov 14 11:11:10 user nova-compute[75255]:   <os>
Nov 14 11:11:10 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:11:10 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:11:10 user nova-compute[75255]:   </os>
Nov 14 11:11:10 user nova-compute[75255]:   <features>
Nov 14 11:11:10 user nova-compute[75255]:     <acpi/>
Nov 14 11:11:10 user nova-compute[75255]:     <apic/>
Nov 14 11:11:10 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:11:10 user nova-compute[75255]:   </features>
Nov 14 11:11:10 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:11:10 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:11:10 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:11:10 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:11:10 user nova-compute[75255]:   </clock>
Nov 14 11:11:10 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:11:10 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:11:10 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:11:10 user nova-compute[75255]:   </cpu>
Nov 14 11:11:10 user nova-compute[75255]:   <devices>
Nov 14 11:11:10 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:11:10 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:11:10 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue"/>
Nov 14 11:11:10 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:11:10 user nova-compute[75255]:     </disk>
Nov 14 11:11:10 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:11:10 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:11:10 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk"/>
Nov 14 11:11:10 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:11:10 user nova-compute[75255]:     </disk>
Nov 14 11:11:10 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:10 user nova-compute[75255]:       <mac address="fa:16:3e:f7:c9:63"/>
Nov 14 11:11:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:10 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:10 user nova-compute[75255]:       <target dev="tap7853a5a2-53"/>
Nov 14 11:11:10 user nova-compute[75255]:     </interface>
Nov 14 11:11:10 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:11:10 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/console.log" append="off"/>
Nov 14 11:11:10 user nova-compute[75255]:     </serial>
Nov 14 11:11:10 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:11:10 user nova-compute[75255]:     <video>
Nov 14 11:11:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:10 user nova-compute[75255]:     </video>
Nov 14 11:11:10 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:11:10 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:11:10 user nova-compute[75255]:     </rng>
Nov 14 11:11:10 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:11:10 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:11:10 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:11:10 user nova-compute[75255]:     </memballoon>
Nov 14 11:11:10 user nova-compute[75255]:   </devices>
Nov 14 11:11:10 user nova-compute[75255]: </domain>
Nov 14 11:11:10 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:11:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance destroyed successfully.
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:11:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No VIF found with MAC fa:16:3e:f7:c9:63, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:11:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [{"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance network_info: |[{"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:11:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:11 user nova-compute[75255]: DEBUG nova.network.neutron [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port 9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updated VIF entry in instance network info cache for port 9e99fa23-783f-4c65-8a2b-4e62f2636047. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [{"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-51e526ad-60cb-4071-bc74-a01406b3571e. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port 51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:12 user nova-compute[75255]: WARNING nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:12 user nova-compute[75255]: WARNING nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:12 user nova-compute[75255]: WARNING nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:12 user nova-compute[75255]: WARNING nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:12 user nova-compute[75255]: WARNING nova.compute.manager [req-98672197-5fd0-4cf6-8744-4c8b828b793b req-57268846-6102-49a0-b435-7219f9f179aa service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updated VIF entry in instance network info cache for port 51e526ad-60cb-4071-bc74-a01406b3571e. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:11:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [{"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94c41528-e460-4dcb-9995-ffd56243514c req-7a6c8e8e-695e-4490-a64c-f6c12af73043 service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:14 user nova-compute[75255]: WARNING nova.compute.manager [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:14 user nova-compute[75255]: WARNING nova.compute.manager [req-740e4e1e-02bb-4f7b-9cd0-bf9c9a5e4fd4 req-ad8fc453-b513-408e-8f92-dfd95a9012d5 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state rescuing.
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-fb08110b-9184-4d74-a4f7-a8ee789a88d0 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:11:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Creating image(s)
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Ensure instance console log exists: /opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Start _get_guest_xml network_info=[{"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '3a8ff274-1aa3-4878-92ab-469437faf4fe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkywjzHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b608f6b-e6ae-4530-8f05-05871ebace54', 'attached_at': '', 'detached_at': '', 'volume_id': '8dd638b1-00a5-439f-9bbf-e68edde8f685', 'serial': '8dd638b1-00a5-439f-9bbf-e68edde8f685'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '6c905346-5eed-4ecf-a2b4-0d7b07eef603', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOFzsKmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b608f6b-e6ae-4530-8f05-05871ebace54', 'attached_at': '', 'detached_at': '', 'volume_id': '2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f', 'serial': '2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e0e97796-a45d-4adc-b662-b217e9be29e6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrRNkIlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b608f6b-e6ae-4530-8f05-05871ebace54', 'attached_at': '', 'detached_at': '', 'volume_id': '61d6843d-811f-480d-8879-b58a37b22649', 'serial': '61d6843d-811f-480d-8879-b58a37b22649'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:11:14 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:14 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkywjzHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:14 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:14 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:14 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78106c9-434a-4e98-8efb-ff7eff8b32c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:11:14 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[677ca76f-5fbc-4af8-b732-fd1f7f1b25a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685] added
Nov 14 11:11:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adce458-1d1e-401a-9ccc-a69baa25cd19]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b74ed35-cb80-4cb1-afa3-c5bb6bcdfe29]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkywjzHd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkywjzHd" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e8964-3c4e-4fd4-bb28-63d7a07a1094]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RkywjzHd'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7688d-3108-4ed0-9c38-949d189029bd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05b2fe7-5f5f-416c-8489-9dfb38b42016]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7424d85a-31ef-4098-ba87-9577cb163e32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260]
Nov 14 11:11:14 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260] successful.
Nov 14 11:11:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c634009a-3af6-49b5-9a80-156914f005cc]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[affa764e-a216-4677-8d30-da9129903a52]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b8fdcd-96fd-44e3-8d64-fbd4a1258f2e]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:11:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkywjzHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23230393363356263', 'path': '/dev/sdd'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230393363356263', 'path': '/dev/sdd'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOFzsKmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:15 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:15 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:15 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:11:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1036f1cc-67b5-46c2-88a0-0d1767c6af28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:11:16 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a82481-99de-4e43-82c3-7846a1efc67a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f] added
Nov 14 11:11:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb5be82-1a52-4d14-b6a7-ada0c43cb031]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62e65ce-9c1a-4723-b83b-01ca41a569df]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BOFzsKmq {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BOFzsKmq" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b778aa66-27b3-4f8f-8985-af676ffb8818]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BOFzsKmq'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3680c52c-9ac2-4e1f-bbfa-827305fbc340]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f788738-dc0b-4947-bb1d-8353ff87144f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2f31e-6136-45ea-8fda-a503df4d8396]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260]
Nov 14 11:11:16 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260] successful.
Nov 14 11:11:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc06b259-7760-4079-a546-c01bc20b2eb3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9070f155-c827-4ca1-80e9-e68e19dcb630]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:16 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58296b4-08f4-4c9a-aa23-cdd627e01313]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOFzsKmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26364303466313431', 'path': '/dev/sdf'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364303466313431', 'path': '/dev/sdf'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrRNkIlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:17 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1abcecb-9b3e-4241-984b-8a306865184c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:11:17 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a0b2eb-7018-4842-bf8b-643e135f28f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649] added
Nov 14 11:11:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2476b1e7-489f-4e3b-bfa4-64c864ce8adb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab779bf-cc6b-45e7-a763-ecd025874f56]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrRNkIlA {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrRNkIlA" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e9a457-691b-464e-bf03-5f37f71f1ddd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrRNkIlA'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[594548d4-cb96-4974-a8a8-811480d14642]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac43c85e-1080-4a90-962c-be2f4cb9dc03]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e458a-4ef7-44e2-bd00-3fb38769390d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260]
Nov 14 11:11:17 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260] successful.
Nov 14 11:11:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc401e36-5a56-4a33-a294-4a70e803eee6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06eb992-c1dc-4dea-bb14-f89f8439ecea]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3fe1e0-a556-4342-9e3b-046119ee28a1]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrRNkIlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26362616139663239', 'path': '/dev/sdg'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362616139663239', 'path': '/dev/sdg'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9a:5d,bridge_name='br-int',has_traffic_filtering=True,id=b809feb7-2144-4123-8de8-43451d6ec258,network=Network(b19d91dd-285e-45f8-bbe4-d04b2bbddce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb809feb7-21') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:df:ed,bridge_name='br-int',has_traffic_filtering=True,id=ab2e7ac9-e023-4327-9b99-e33b65e1ffed,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab2e7ac9-e0') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:e0,bridge_name='br-int',has_traffic_filtering=True,id=5ad47315-5fa1-4867-bb4b-087b246d1751,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ad47315-5f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed2cf92-6f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:bf:69,bridge_name='br-int',has_traffic_filtering=True,id=5578eb30-f8cc-4113-943f-ec533b734589,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5578eb30-f8') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=9e99fa23-783f-4c65-8a2b-4e62f2636047,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e99fa23-78') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:9a:1d,bridge_name='br-int',has_traffic_filtering=True,id=51e526ad-60cb-4071-bc74-a01406b3571e,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e526ad-60') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b608f6b-e6ae-4530-8f05-05871ebace54 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:11:18 user nova-compute[75255]:   <uuid>1b608f6b-e6ae-4530-8f05-05871ebace54</uuid>
Nov 14 11:11:18 user nova-compute[75255]:   <name>instance-0000000f</name>
Nov 14 11:11:18 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:11:18 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:11:18 user nova-compute[75255]:   <metadata>
Nov 14 11:11:18 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:11:18 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:11:18 user nova-compute[75255]:       <nova:name>tempest-device-tagging-server-664434946</nova:name>
Nov 14 11:11:18 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:11:14</nova:creationTime>
Nov 14 11:11:18 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:11:18 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:11:18 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:11:18 user nova-compute[75255]:       <nova:owner>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:user uuid="ed1e0e782ec1411bae848a63a9e76c72">tempest-TaggedBootDevicesTest_v242-1557158929-project-member</nova:user>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:project uuid="a0ae70ce6a6c46a5a7558971f96ddf5e">tempest-TaggedBootDevicesTest_v242-1557158929</nova:project>
Nov 14 11:11:18 user nova-compute[75255]:       </nova:owner>
Nov 14 11:11:18 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:11:18 user nova-compute[75255]:       <nova:ports>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:port uuid="b809feb7-2144-4123-8de8-43451d6ec258">
Nov 14 11:11:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:11:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:port uuid="ab2e7ac9-e023-4327-9b99-e33b65e1ffed">
Nov 14 11:11:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Nov 14 11:11:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:port uuid="5ad47315-5fa1-4867-bb4b-087b246d1751">
Nov 14 11:11:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.58" ipVersion="4"/>
Nov 14 11:11:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:port uuid="4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3">
Nov 14 11:11:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
Nov 14 11:11:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:port uuid="5578eb30-f8cc-4113-943f-ec533b734589">
Nov 14 11:11:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
Nov 14 11:11:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:port uuid="9e99fa23-783f-4c65-8a2b-4e62f2636047">
Nov 14 11:11:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 11:11:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:18 user nova-compute[75255]:         <nova:port uuid="51e526ad-60cb-4071-bc74-a01406b3571e">
Nov 14 11:11:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 11:11:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:18 user nova-compute[75255]:       </nova:ports>
Nov 14 11:11:18 user nova-compute[75255]:     </nova:instance>
Nov 14 11:11:18 user nova-compute[75255]:   </metadata>
Nov 14 11:11:18 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:11:18 user nova-compute[75255]:     <system>
Nov 14 11:11:18 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:11:18 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:11:18 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:11:18 user nova-compute[75255]:       <entry name="serial">1b608f6b-e6ae-4530-8f05-05871ebace54</entry>
Nov 14 11:11:18 user nova-compute[75255]:       <entry name="uuid">1b608f6b-e6ae-4530-8f05-05871ebace54</entry>
Nov 14 11:11:18 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:11:18 user nova-compute[75255]:     </system>
Nov 14 11:11:18 user nova-compute[75255]:   </sysinfo>
Nov 14 11:11:18 user nova-compute[75255]:   <os>
Nov 14 11:11:18 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:11:18 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:11:18 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:11:18 user nova-compute[75255]:   </os>
Nov 14 11:11:18 user nova-compute[75255]:   <features>
Nov 14 11:11:18 user nova-compute[75255]:     <acpi/>
Nov 14 11:11:18 user nova-compute[75255]:     <apic/>
Nov 14 11:11:18 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:11:18 user nova-compute[75255]:   </features>
Nov 14 11:11:18 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:11:18 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:11:18 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:11:18 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:11:18 user nova-compute[75255]:   </clock>
Nov 14 11:11:18 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:11:18 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:11:18 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:11:18 user nova-compute[75255]:   </cpu>
Nov 14 11:11:18 user nova-compute[75255]:   <devices>
Nov 14 11:11:18 user nova-compute[75255]:     <disk type="file" device="cdrom">
Nov 14 11:11:18 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 11:11:18 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54/disk.config"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="hda" bus="ide"/>
Nov 14 11:11:18 user nova-compute[75255]:     </disk>
Nov 14 11:11:18 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:11:18 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:18 user nova-compute[75255]:       <source dev="/dev/sdd"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <serial>8dd638b1-00a5-439f-9bbf-e68edde8f685</serial>
Nov 14 11:11:18 user nova-compute[75255]:     </disk>
Nov 14 11:11:18 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:11:18 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:18 user nova-compute[75255]:       <source dev="/dev/sdf"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <serial>2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f</serial>
Nov 14 11:11:18 user nova-compute[75255]:     </disk>
Nov 14 11:11:18 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:11:18 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:18 user nova-compute[75255]:       <source dev="/dev/sdg"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="vdc" bus="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <serial>61d6843d-811f-480d-8879-b58a37b22649</serial>
Nov 14 11:11:18 user nova-compute[75255]:     </disk>
Nov 14 11:11:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:18 user nova-compute[75255]:       <mac address="fa:16:3e:5f:9a:5d"/>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="tapb809feb7-21"/>
Nov 14 11:11:18 user nova-compute[75255]:     </interface>
Nov 14 11:11:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:18 user nova-compute[75255]:       <mac address="fa:16:3e:76:df:ed"/>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="tapab2e7ac9-e0"/>
Nov 14 11:11:18 user nova-compute[75255]:     </interface>
Nov 14 11:11:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:18 user nova-compute[75255]:       <mac address="fa:16:3e:de:80:e0"/>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="tap5ad47315-5f"/>
Nov 14 11:11:18 user nova-compute[75255]:     </interface>
Nov 14 11:11:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:18 user nova-compute[75255]:       <mac address="fa:16:3e:59:52:c1"/>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="tap4ed2cf92-6f"/>
Nov 14 11:11:18 user nova-compute[75255]:     </interface>
Nov 14 11:11:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:18 user nova-compute[75255]:       <mac address="fa:16:3e:8c:bf:69"/>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="tap5578eb30-f8"/>
Nov 14 11:11:18 user nova-compute[75255]:     </interface>
Nov 14 11:11:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:18 user nova-compute[75255]:       <mac address="fa:16:3e:66:03:8c"/>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="tap9e99fa23-78"/>
Nov 14 11:11:18 user nova-compute[75255]:     </interface>
Nov 14 11:11:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:18 user nova-compute[75255]:       <mac address="fa:16:3e:a3:9a:1d"/>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:18 user nova-compute[75255]:       <target dev="tap51e526ad-60"/>
Nov 14 11:11:18 user nova-compute[75255]:     </interface>
Nov 14 11:11:18 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:11:18 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54/console.log" append="off"/>
Nov 14 11:11:18 user nova-compute[75255]:     </serial>
Nov 14 11:11:18 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:11:18 user nova-compute[75255]:     <video>
Nov 14 11:11:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:18 user nova-compute[75255]:     </video>
Nov 14 11:11:18 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:11:18 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:11:18 user nova-compute[75255]:     </rng>
Nov 14 11:11:18 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:11:18 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:11:18 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:11:18 user nova-compute[75255]:     </memballoon>
Nov 14 11:11:18 user nova-compute[75255]:   </devices>
Nov 14 11:11:18 user nova-compute[75255]: </domain>
Nov 14 11:11:18 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9a:5d,bridge_name='br-int',has_traffic_filtering=True,id=b809feb7-2144-4123-8de8-43451d6ec258,network=Network(b19d91dd-285e-45f8-bbe4-d04b2bbddce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb809feb7-21') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9a:5d,bridge_name='br-int',has_traffic_filtering=True,id=b809feb7-2144-4123-8de8-43451d6ec258,network=Network(b19d91dd-285e-45f8-bbe4-d04b2bbddce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb809feb7-21') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e832c259-88ad-587b-9233-80a9c74c7007', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb809feb7-21, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb809feb7-21, col_values=(('qos', UUID('dc6eff95-969b-449b-9171-31b1230894c5')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb809feb7-21, col_values=(('external_ids', {'iface-id': 'b809feb7-2144-4123-8de8-43451d6ec258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:9a:5d', 'vm-uuid': '1b608f6b-e6ae-4530-8f05-05871ebace54'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: INFO os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9a:5d,bridge_name='br-int',has_traffic_filtering=True,id=b809feb7-2144-4123-8de8-43451d6ec258,network=Network(b19d91dd-285e-45f8-bbe4-d04b2bbddce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb809feb7-21')
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:df:ed,bridge_name='br-int',has_traffic_filtering=True,id=ab2e7ac9-e023-4327-9b99-e33b65e1ffed,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab2e7ac9-e0') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:df:ed,bridge_name='br-int',has_traffic_filtering=True,id=ab2e7ac9-e023-4327-9b99-e33b65e1ffed,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab2e7ac9-e0') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c68c9bf4-ddd1-501e-a9f9-d55e41a262d6', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab2e7ac9-e0, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab2e7ac9-e0, col_values=(('qos', UUID('a6998c27-603d-44c9-90d6-0ef3bd0d5a30')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab2e7ac9-e0, col_values=(('external_ids', {'iface-id': 'ab2e7ac9-e023-4327-9b99-e33b65e1ffed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:df:ed', 'vm-uuid': '1b608f6b-e6ae-4530-8f05-05871ebace54'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: INFO os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:df:ed,bridge_name='br-int',has_traffic_filtering=True,id=ab2e7ac9-e023-4327-9b99-e33b65e1ffed,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab2e7ac9-e0')
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:e0,bridge_name='br-int',has_traffic_filtering=True,id=5ad47315-5fa1-4867-bb4b-087b246d1751,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ad47315-5f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:e0,bridge_name='br-int',has_traffic_filtering=True,id=5ad47315-5fa1-4867-bb4b-087b246d1751,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ad47315-5f') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0026d675-214d-537a-bcc4-37da224c5d11', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ad47315-5f, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ad47315-5f, col_values=(('qos', UUID('c16eef9a-b24b-4f9b-be2f-0f4ad331f069')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ad47315-5f, col_values=(('external_ids', {'iface-id': '5ad47315-5fa1-4867-bb4b-087b246d1751', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:80:e0', 'vm-uuid': '1b608f6b-e6ae-4530-8f05-05871ebace54'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: INFO os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:e0,bridge_name='br-int',has_traffic_filtering=True,id=5ad47315-5fa1-4867-bb4b-087b246d1751,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ad47315-5f')
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed2cf92-6f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed2cf92-6f') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98efa566-c0e7-50e1-a014-190db13aca0e', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ed2cf92-6f, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ed2cf92-6f, col_values=(('qos', UUID('b0fc0247-256d-4aa1-b66a-1caf07373745')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ed2cf92-6f, col_values=(('external_ids', {'iface-id': '4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:52:c1', 'vm-uuid': '1b608f6b-e6ae-4530-8f05-05871ebace54'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: INFO os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed2cf92-6f')
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:bf:69,bridge_name='br-int',has_traffic_filtering=True,id=5578eb30-f8cc-4113-943f-ec533b734589,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5578eb30-f8') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:bf:69,bridge_name='br-int',has_traffic_filtering=True,id=5578eb30-f8cc-4113-943f-ec533b734589,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5578eb30-f8') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '371fd4d3-3f61-5302-a0e2-881e3f37065e', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5578eb30-f8, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5578eb30-f8, col_values=(('qos', UUID('357c2b7f-61a3-4979-a718-8c8497efb15a')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5578eb30-f8, col_values=(('external_ids', {'iface-id': '5578eb30-f8cc-4113-943f-ec533b734589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:bf:69', 'vm-uuid': '1b608f6b-e6ae-4530-8f05-05871ebace54'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: INFO os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:bf:69,bridge_name='br-int',has_traffic_filtering=True,id=5578eb30-f8cc-4113-943f-ec533b734589,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5578eb30-f8')
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=9e99fa23-783f-4c65-8a2b-4e62f2636047,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e99fa23-78') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=9e99fa23-783f-4c65-8a2b-4e62f2636047,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e99fa23-78') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6c4d4f9-c89e-57b2-8d43-eaa6a04dbf7a', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e99fa23-78, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e99fa23-78, col_values=(('qos', UUID('edbfc433-ad7f-4095-82a1-cd330e8e27ac')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e99fa23-78, col_values=(('external_ids', {'iface-id': '9e99fa23-783f-4c65-8a2b-4e62f2636047', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:03:8c', 'vm-uuid': '1b608f6b-e6ae-4530-8f05-05871ebace54'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: INFO os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=9e99fa23-783f-4c65-8a2b-4e62f2636047,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e99fa23-78')
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:9a:1d,bridge_name='br-int',has_traffic_filtering=True,id=51e526ad-60cb-4071-bc74-a01406b3571e,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e526ad-60') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:9a:1d,bridge_name='br-int',has_traffic_filtering=True,id=51e526ad-60cb-4071-bc74-a01406b3571e,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e526ad-60') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d8bd4a5-f492-5938-a495-f895dd6218f4', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51e526ad-60, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51e526ad-60, col_values=(('qos', UUID('de664c8d-6e3a-4782-b1af-4c27349ba52c')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51e526ad-60, col_values=(('external_ids', {'iface-id': '51e526ad-60cb-4071-bc74-a01406b3571e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:9a:1d', 'vm-uuid': '1b608f6b-e6ae-4530-8f05-05871ebace54'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:19 user nova-compute[75255]: INFO os_vif [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:9a:1d,bridge_name='br-int',has_traffic_filtering=True,id=51e526ad-60cb-4071-bc74-a01406b3571e,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e526ad-60')
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] No BDM found with device name hda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] No VIF found with MAC fa:16:3e:5f:9a:5d, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:11:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] No VIF found with MAC fa:16:3e:8c:bf:69, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:11:19 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Using config drive
Nov 14 11:11:20 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Creating config drive at /opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54/disk.config
Nov 14 11:11:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3m5itz3i {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3m5itz3i" returned: 0 in 0.088s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:21 user nova-compute[75255]: INFO nova.compute.manager [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Detaching volume 2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:11:21 user nova-compute[75255]: INFO nova.virt.block_device [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Attempting to driver detach volume 2951755d-901c-4201-807e-ccf0536a2981 from mountpoint /dev/vdb
Nov 14 11:11:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Attempting to detach device vdb from instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:11:21 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:21 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:11:21 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:11:21 user nova-compute[75255]:   <serial>2951755d-901c-4201-807e-ccf0536a2981</serial>
Nov 14 11:11:21 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:11:21 user nova-compute[75255]: </disk>
Nov 14 11:11:21 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:11:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully detached device vdb from instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea from the persistent domain config.
Nov 14 11:11:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:11:21 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:21 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:11:21 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:11:21 user nova-compute[75255]:   <serial>2951755d-901c-4201-807e-ccf0536a2981</serial>
Nov 14 11:11:21 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:11:21 user nova-compute[75255]: </disk>
Nov 14 11:11:21 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-7e6a62c2-043b-466a-aa86-21f722f07ecf req-171f9aa4-9b66-421e-bcd7-1a8125abac4f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e6a62c2-043b-466a-aa86-21f722f07ecf req-171f9aa4-9b66-421e-bcd7-1a8125abac4f service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e6a62c2-043b-466a-aa86-21f722f07ecf req-171f9aa4-9b66-421e-bcd7-1a8125abac4f service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e6a62c2-043b-466a-aa86-21f722f07ecf req-171f9aa4-9b66-421e-bcd7-1a8125abac4f service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-7e6a62c2-043b-466a-aa86-21f722f07ecf req-171f9aa4-9b66-421e-bcd7-1a8125abac4f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:22 user nova-compute[75255]: WARNING nova.compute.manager [req-7e6a62c2-043b-466a-aa86-21f722f07ecf req-171f9aa4-9b66-421e-bcd7-1a8125abac4f service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 for instance with vm_state building and task_state spawning.
Nov 14 11:11:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-68061741-66e9-4d88-bf40-accdc9f5ff93 req-e2a31310-682d-4d4a-b84a-a25cd4c6d318 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-68061741-66e9-4d88-bf40-accdc9f5ff93 req-e2a31310-682d-4d4a-b84a-a25cd4c6d318 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-68061741-66e9-4d88-bf40-accdc9f5ff93 req-e2a31310-682d-4d4a-b84a-a25cd4c6d318 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-68061741-66e9-4d88-bf40-accdc9f5ff93 req-e2a31310-682d-4d4a-b84a-a25cd4c6d318 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-68061741-66e9-4d88-bf40-accdc9f5ff93 req-e2a31310-682d-4d4a-b84a-a25cd4c6d318 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:24 user nova-compute[75255]: WARNING nova.compute.manager [req-68061741-66e9-4d88-bf40-accdc9f5ff93 req-e2a31310-682d-4d4a-b84a-a25cd4c6d318 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed for instance with vm_state building and task_state spawning.
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:24 user nova-compute[75255]: WARNING nova.compute.manager [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 for instance with vm_state building and task_state spawning.
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:24 user nova-compute[75255]: WARNING nova.compute.manager [req-01f9ba8b-4b0c-4407-b280-a59e26153d75 req-673a6105-bd84-4e47-a890-5ce59f631847 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 for instance with vm_state building and task_state spawning.
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-22d399c7-9996-4159-8567-deae68dae2dd req-810594e8-757c-4e45-a25a-ca652144315b service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-22d399c7-9996-4159-8567-deae68dae2dd req-810594e8-757c-4e45-a25a-ca652144315b service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-22d399c7-9996-4159-8567-deae68dae2dd req-810594e8-757c-4e45-a25a-ca652144315b service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-22d399c7-9996-4159-8567-deae68dae2dd req-810594e8-757c-4e45-a25a-ca652144315b service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-22d399c7-9996-4159-8567-deae68dae2dd req-810594e8-757c-4e45-a25a-ca652144315b service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:24 user nova-compute[75255]: WARNING nova.compute.manager [req-22d399c7-9996-4159-8567-deae68dae2dd req-810594e8-757c-4e45-a25a-ca652144315b service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 for instance with vm_state building and task_state spawning.
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed for instance with vm_state building and task_state spawning.
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 for instance with vm_state building and task_state spawning.
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 for instance with vm_state building and task_state spawning.
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 for instance with vm_state building and task_state spawning.
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 for instance with vm_state building and task_state spawning.
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-34c99410-b5aa-4312-83dc-051df6b345de req-7412f4bf-3493-4b2a-9b0d-2dee80786508 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e for instance with vm_state building and task_state spawning.
Nov 14 11:11:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c4d9cbf-2630-4754-8f7b-974530246cfb req-cebe1e41-8996-4a85-912b-3d24bc3f5ad6 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c4d9cbf-2630-4754-8f7b-974530246cfb req-cebe1e41-8996-4a85-912b-3d24bc3f5ad6 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c4d9cbf-2630-4754-8f7b-974530246cfb req-cebe1e41-8996-4a85-912b-3d24bc3f5ad6 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c4d9cbf-2630-4754-8f7b-974530246cfb req-cebe1e41-8996-4a85-912b-3d24bc3f5ad6 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c4d9cbf-2630-4754-8f7b-974530246cfb req-cebe1e41-8996-4a85-912b-3d24bc3f5ad6 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-8c4d9cbf-2630-4754-8f7b-974530246cfb req-cebe1e41-8996-4a85-912b-3d24bc3f5ad6 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 for instance with vm_state building and task_state spawning.
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-f7b43db3-e60c-4089-b966-7d315eb74389 req-b5adf1cf-3aa1-4d66-8d92-02f3a680bcc8 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f7b43db3-e60c-4089-b966-7d315eb74389 req-b5adf1cf-3aa1-4d66-8d92-02f3a680bcc8 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f7b43db3-e60c-4089-b966-7d315eb74389 req-b5adf1cf-3aa1-4d66-8d92-02f3a680bcc8 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f7b43db3-e60c-4089-b966-7d315eb74389 req-b5adf1cf-3aa1-4d66-8d92-02f3a680bcc8 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-f7b43db3-e60c-4089-b966-7d315eb74389 req-b5adf1cf-3aa1-4d66-8d92-02f3a680bcc8 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:26 user nova-compute[75255]: WARNING nova.compute.manager [req-f7b43db3-e60c-4089-b966-7d315eb74389 req-b5adf1cf-3aa1-4d66-8d92-02f3a680bcc8 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 for instance with vm_state building and task_state spawning.
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:11:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance spawned successfully.
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:27 user nova-compute[75255]: INFO nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Took 13.29 seconds to spawn the instance on the hypervisor.
Nov 14 11:11:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:27 user nova-compute[75255]: INFO nova.compute.manager [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Took 29.90 seconds to build instance.
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f98f0a15-db82-461e-84cd-6a754b4a0a45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.039s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:28 user nova-compute[75255]: WARNING nova.compute.manager [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e for instance with vm_state active and task_state None.
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing instance network info cache due to event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] Acquiring lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] Acquired lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing instance network info cache due to event network-changed-b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] Acquiring lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:29 user nova-compute[75255]: INFO nova.compute.manager [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Detaching volume 94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:29 user nova-compute[75255]: INFO nova.virt.block_device [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Attempting to driver detach volume 94c271a1-ddf7-49f9-a84e-b7034f98515e from mountpoint /dev/vdb
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.network.neutron [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updated VIF entry in instance network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.network.neutron [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Attempting to detach device vdb from instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:11:29 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:29 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:11:29 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:11:29 user nova-compute[75255]:   <serial>94c271a1-ddf7-49f9-a84e-b7034f98515e</serial>
Nov 14 11:11:29 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:11:29 user nova-compute[75255]: </disk>
Nov 14 11:11:29 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a093c3a6-a148-4eda-ba01-3b7f6126ce88 req-062b09e6-ef6f-4985-b192-b5d3d025e999 service nova] Releasing lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] Acquired lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.network.neutron [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Refreshing network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:29 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully detached device vdb from instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e from the persistent domain config.
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:11:29 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:29 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:11:29 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:11:29 user nova-compute[75255]:   <serial>94c271a1-ddf7-49f9-a84e-b7034f98515e</serial>
Nov 14 11:11:29 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:11:29 user nova-compute[75255]: </disk>
Nov 14 11:11:29 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.network.neutron [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updated VIF entry in instance network info cache for port b13a195e-5614-4f79-8037-b0a124f021dc. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG nova.network.neutron [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [{"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b706ee3c-bd6f-44d6-b8fe-e86d91fa7758 req-e5f8cb04-3cea-4ab0-b2ca-91cb37320278 service nova] Releasing lock "refresh_cache-844fb83b-7dc0-4720-bacc-52917c1d3c6e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:30 user nova-compute[75255]: INFO nova.compute.manager [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Terminating instance
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:30 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:11:30 user nova-compute[75255]: INFO nova.compute.claims [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Claim successful on node user
Nov 14 11:11:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Instance destroyed successfully.
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lazy-loading 'resources' on Instance uuid 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-875523292',display_name='tempest-VolumesAdminNegativeTest-server-875523292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-875523292',id=14,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea68b5a52247427da8880074883a4ce6',ramdisk_id='',reservation_id='r-dbms7k1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-222875096',owner_user_name='tempest-VolumesAdminNegativeTest-222875096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:09:43Z,user_data=None,user_id='52279ec6cb8044ad9b7b81808b7631dd',uuid=647e4297-1b9e-45ab-a9f6-9d2d5fb804e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converting VIF {"id": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "address": "fa:16:3e:14:85:02", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d78822-43", "ovs_interfaceid": "b3d78822-4393-4b4c-9b91-2cdff14b0aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:85:02,bridge_name='br-int',has_traffic_filtering=True,id=b3d78822-4393-4b4c-9b91-2cdff14b0aa3,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d78822-43') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG os_vif [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:85:02,bridge_name='br-int',has_traffic_filtering=True,id=b3d78822-4393-4b4c-9b91-2cdff14b0aa3,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d78822-43') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3d78822-43, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5aa9f83-eddd-44f5-b623-ffb37a21fe2e) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:31 user nova-compute[75255]: INFO os_vif [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:85:02,bridge_name='br-int',has_traffic_filtering=True,id=b3d78822-4393-4b4c-9b91-2cdff14b0aa3,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d78822-43')
Nov 14 11:11:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Deleting instance files /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7_del
Nov 14 11:11:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Deletion of /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7_del complete
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:11:31 user nova-compute[75255]: INFO nova.compute.manager [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 14 11:11:31 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json" returned: 1 in 0.219s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk --force-share --output=json' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:11:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/647e4297-1b9e-45ab-a9f6-9d2d5fb804e7/disk
Nov 14 11:11:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:11:32 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:32 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7924MB free_disk=25.384990692138672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Applying migration context for instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c as it has an incoming, in-progress migration f25766aa-a2ee-4894-9983-8a2721132a98. Migration status is finished {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 11:11:32 user nova-compute[75255]: INFO nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating resource usage from migration f25766aa-a2ee-4894-9983-8a2721132a98
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.policy [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b82af4602b649889188f0f943c63896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb07eaf3ea24939aeef6eba1bb2293d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2e186944-c41d-4f07-b852-ff17b2241241 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Migration f25766aa-a2ee-4894-9983-8a2721132a98 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1b608f6b-e6ae-4530-8f05-05871ebace54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:11:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Creating image(s)
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "/opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.197s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk 1073741824" returned: 0 in 0.059s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Successfully created port: f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.222s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:32 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:33 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Took 1.53 seconds to deallocate network for instance.
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-04f64908-d14a-4e99-ac10-b23ddafdfbac req-37dd5be7-5964-4e0c-a06c-ea2ac981cd63 service nova] [instance: 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7] Received event network-vif-deleted-b3d78822-4393-4b4c-9b91-2cdff14b0aa3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Cannot resize image /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Ensure instance console log exists: /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:33 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Deleted allocations for instance 647e4297-1b9e-45ab-a9f6-9d2d5fb804e7
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Successfully updated port: f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f5f27f49-13d6-4e62-8504-8f072739da89 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "647e4297-1b9e-45ab-a9f6-9d2d5fb804e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.036s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received event network-changed-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Refreshing instance network info cache due to event network-changed-f73601c1-a2b3-45dd-9174-fd98d9300035. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] Acquiring lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updating instance_info_cache with network_info: [{"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Instance network_info: |[{"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] Acquired lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Refreshing network info cache for port f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Start _get_guest_xml network_info=[{"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:11:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-74556287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-74556287',id=16,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-dv80n202',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:11:32Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=24e046fb-04f4-49f8-bfa8-951334e25e5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d0:95,bridge_name='br-int',has_traffic_filtering=True,id=f73601c1-a2b3-45dd-9174-fd98d9300035,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73601c1-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'pci_devices' on Instance uuid 24e046fb-04f4-49f8-bfa8-951334e25e5f {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:11:34 user nova-compute[75255]:   <uuid>24e046fb-04f4-49f8-bfa8-951334e25e5f</uuid>
Nov 14 11:11:34 user nova-compute[75255]:   <name>instance-00000010</name>
Nov 14 11:11:34 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:11:34 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:11:34 user nova-compute[75255]:   <metadata>
Nov 14 11:11:34 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:11:34 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:11:34 user nova-compute[75255]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-74556287</nova:name>
Nov 14 11:11:34 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:11:34</nova:creationTime>
Nov 14 11:11:34 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:11:34 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:11:34 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:11:34 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:11:34 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:11:34 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:11:34 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:11:34 user nova-compute[75255]:       <nova:owner>
Nov 14 11:11:34 user nova-compute[75255]:         <nova:user uuid="3b82af4602b649889188f0f943c63896">tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member</nova:user>
Nov 14 11:11:34 user nova-compute[75255]:         <nova:project uuid="bbb07eaf3ea24939aeef6eba1bb2293d">tempest-ServerBootFromVolumeStableRescueTest-1912178200</nova:project>
Nov 14 11:11:34 user nova-compute[75255]:       </nova:owner>
Nov 14 11:11:34 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:11:34 user nova-compute[75255]:       <nova:ports>
Nov 14 11:11:34 user nova-compute[75255]:         <nova:port uuid="f73601c1-a2b3-45dd-9174-fd98d9300035">
Nov 14 11:11:34 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 11:11:34 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:34 user nova-compute[75255]:       </nova:ports>
Nov 14 11:11:34 user nova-compute[75255]:     </nova:instance>
Nov 14 11:11:34 user nova-compute[75255]:   </metadata>
Nov 14 11:11:34 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:11:34 user nova-compute[75255]:     <system>
Nov 14 11:11:34 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:11:34 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:11:34 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:11:34 user nova-compute[75255]:       <entry name="serial">24e046fb-04f4-49f8-bfa8-951334e25e5f</entry>
Nov 14 11:11:34 user nova-compute[75255]:       <entry name="uuid">24e046fb-04f4-49f8-bfa8-951334e25e5f</entry>
Nov 14 11:11:34 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:11:34 user nova-compute[75255]:     </system>
Nov 14 11:11:34 user nova-compute[75255]:   </sysinfo>
Nov 14 11:11:34 user nova-compute[75255]:   <os>
Nov 14 11:11:34 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:11:34 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:11:34 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:11:34 user nova-compute[75255]:   </os>
Nov 14 11:11:34 user nova-compute[75255]:   <features>
Nov 14 11:11:34 user nova-compute[75255]:     <acpi/>
Nov 14 11:11:34 user nova-compute[75255]:     <apic/>
Nov 14 11:11:34 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:11:34 user nova-compute[75255]:   </features>
Nov 14 11:11:34 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:11:34 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:11:34 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:11:34 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:11:34 user nova-compute[75255]:   </clock>
Nov 14 11:11:34 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:11:34 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:11:34 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:11:34 user nova-compute[75255]:   </cpu>
Nov 14 11:11:34 user nova-compute[75255]:   <devices>
Nov 14 11:11:34 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:11:34 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:11:34 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk"/>
Nov 14 11:11:34 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:11:34 user nova-compute[75255]:     </disk>
Nov 14 11:11:34 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:34 user nova-compute[75255]:       <mac address="fa:16:3e:7c:d0:95"/>
Nov 14 11:11:34 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:34 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:34 user nova-compute[75255]:       <target dev="tapf73601c1-a2"/>
Nov 14 11:11:34 user nova-compute[75255]:     </interface>
Nov 14 11:11:34 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:11:34 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/console.log" append="off"/>
Nov 14 11:11:34 user nova-compute[75255]:     </serial>
Nov 14 11:11:34 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:11:34 user nova-compute[75255]:     <video>
Nov 14 11:11:34 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:34 user nova-compute[75255]:     </video>
Nov 14 11:11:34 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:11:34 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:11:34 user nova-compute[75255]:     </rng>
Nov 14 11:11:34 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:11:34 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:11:34 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:11:34 user nova-compute[75255]:     </memballoon>
Nov 14 11:11:34 user nova-compute[75255]:   </devices>
Nov 14 11:11:34 user nova-compute[75255]: </domain>
Nov 14 11:11:34 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-74556287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-74556287',id=16,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-dv80n202',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:11:32Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=24e046fb-04f4-49f8-bfa8-951334e25e5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d0:95,bridge_name='br-int',has_traffic_filtering=True,id=f73601c1-a2b3-45dd-9174-fd98d9300035,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73601c1-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG os_vif [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d0:95,bridge_name='br-int',has_traffic_filtering=True,id=f73601c1-a2b3-45dd-9174-fd98d9300035,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73601c1-a2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4af7b827-d898-5f34-93c2-0d620fcbb21b', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf73601c1-a2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf73601c1-a2, col_values=(('qos', UUID('a4cb603d-1d79-4124-ac8a-d58b5be73cd9')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf73601c1-a2, col_values=(('external_ids', {'iface-id': 'f73601c1-a2b3-45dd-9174-fd98d9300035', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:d0:95', 'vm-uuid': '24e046fb-04f4-49f8-bfa8-951334e25e5f'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:11:34 user nova-compute[75255]: INFO nova.compute.claims [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Claim successful on node user
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:34 user nova-compute[75255]: INFO os_vif [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d0:95,bridge_name='br-int',has_traffic_filtering=True,id=f73601c1-a2b3-45dd-9174-fd98d9300035,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73601c1-a2')
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No VIF found with MAC fa:16:3e:7c:d0:95, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updated VIF entry in instance network info cache for port f73601c1-a2b3-45dd-9174-fd98d9300035. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updating instance_info_cache with network_info: [{"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-93d71eba-f141-404b-8d5b-2c7514b176fd req-f3877d0b-b462-4fff-904a-fe7361d0550b service nova] Releasing lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:11:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:11:34 user nova-compute[75255]: DEBUG nova.policy [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31467e0715d645ecbfbb209e8eba66ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1dfe665b5444728fff969e0156d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:11:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Creating image(s)
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "/opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "/opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk 1073741824" returned: 0 in 0.063s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.208s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Cannot resize image /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Ensure instance console log exists: /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-020050a9-176b-4f40-adde-9284300b0027 req-6e25211a-62b1-4235-8582-652fa82f6166 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received event network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-020050a9-176b-4f40-adde-9284300b0027 req-6e25211a-62b1-4235-8582-652fa82f6166 service nova] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-020050a9-176b-4f40-adde-9284300b0027 req-6e25211a-62b1-4235-8582-652fa82f6166 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-020050a9-176b-4f40-adde-9284300b0027 req-6e25211a-62b1-4235-8582-652fa82f6166 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-020050a9-176b-4f40-adde-9284300b0027 req-6e25211a-62b1-4235-8582-652fa82f6166 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] No waiting events found dispatching network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:36 user nova-compute[75255]: WARNING nova.compute.manager [req-020050a9-176b-4f40-adde-9284300b0027 req-6e25211a-62b1-4235-8582-652fa82f6166 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received unexpected event network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 for instance with vm_state building and task_state spawning.
Nov 14 11:11:36 user nova-compute[75255]: DEBUG nova.network.neutron [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Successfully created port: 7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Successfully updated port: 7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquired lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-changed-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Refreshing instance network info cache due to event network-changed-7492baa9-355a-4952-b448-c87d075c46d5. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] Acquiring lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Releasing lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Instance network_info: |[{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] Acquired lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Refreshing network info cache for port 7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Start _get_guest_xml network_info=[{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:11:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915451133',display_name='tempest-ServerActionsTestOtherA-server-915451133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915451133',id=17,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-dg3had01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=8d0e0752-e32b-4696-abb1-9ca53cae10fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:be:e6,bridge_name='br-int',has_traffic_filtering=True,id=7492baa9-355a-4952-b448-c87d075c46d5,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7492baa9-35') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.objects.instance [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d0e0752-e32b-4696-abb1-9ca53cae10fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:11:37 user nova-compute[75255]:   <uuid>8d0e0752-e32b-4696-abb1-9ca53cae10fc</uuid>
Nov 14 11:11:37 user nova-compute[75255]:   <name>instance-00000011</name>
Nov 14 11:11:37 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:11:37 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:11:37 user nova-compute[75255]:   <metadata>
Nov 14 11:11:37 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:11:37 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:11:37 user nova-compute[75255]:       <nova:name>tempest-ServerActionsTestOtherA-server-915451133</nova:name>
Nov 14 11:11:37 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:11:37</nova:creationTime>
Nov 14 11:11:37 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:11:37 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:11:37 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:11:37 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:11:37 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:11:37 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:11:37 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:11:37 user nova-compute[75255]:       <nova:owner>
Nov 14 11:11:37 user nova-compute[75255]:         <nova:user uuid="31467e0715d645ecbfbb209e8eba66ed">tempest-ServerActionsTestOtherA-1585033744-project-member</nova:user>
Nov 14 11:11:37 user nova-compute[75255]:         <nova:project uuid="3d1dfe665b5444728fff969e0156d205">tempest-ServerActionsTestOtherA-1585033744</nova:project>
Nov 14 11:11:37 user nova-compute[75255]:       </nova:owner>
Nov 14 11:11:37 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:11:37 user nova-compute[75255]:       <nova:ports>
Nov 14 11:11:37 user nova-compute[75255]:         <nova:port uuid="7492baa9-355a-4952-b448-c87d075c46d5">
Nov 14 11:11:37 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 11:11:37 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:37 user nova-compute[75255]:       </nova:ports>
Nov 14 11:11:37 user nova-compute[75255]:     </nova:instance>
Nov 14 11:11:37 user nova-compute[75255]:   </metadata>
Nov 14 11:11:37 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:11:37 user nova-compute[75255]:     <system>
Nov 14 11:11:37 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:11:37 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:11:37 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:11:37 user nova-compute[75255]:       <entry name="serial">8d0e0752-e32b-4696-abb1-9ca53cae10fc</entry>
Nov 14 11:11:37 user nova-compute[75255]:       <entry name="uuid">8d0e0752-e32b-4696-abb1-9ca53cae10fc</entry>
Nov 14 11:11:37 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:11:37 user nova-compute[75255]:     </system>
Nov 14 11:11:37 user nova-compute[75255]:   </sysinfo>
Nov 14 11:11:37 user nova-compute[75255]:   <os>
Nov 14 11:11:37 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:11:37 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:11:37 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:11:37 user nova-compute[75255]:   </os>
Nov 14 11:11:37 user nova-compute[75255]:   <features>
Nov 14 11:11:37 user nova-compute[75255]:     <acpi/>
Nov 14 11:11:37 user nova-compute[75255]:     <apic/>
Nov 14 11:11:37 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:11:37 user nova-compute[75255]:   </features>
Nov 14 11:11:37 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:11:37 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:11:37 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:11:37 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:11:37 user nova-compute[75255]:   </clock>
Nov 14 11:11:37 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:11:37 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:11:37 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:11:37 user nova-compute[75255]:   </cpu>
Nov 14 11:11:37 user nova-compute[75255]:   <devices>
Nov 14 11:11:37 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:11:37 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:11:37 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk"/>
Nov 14 11:11:37 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:11:37 user nova-compute[75255]:     </disk>
Nov 14 11:11:37 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:37 user nova-compute[75255]:       <mac address="fa:16:3e:d9:be:e6"/>
Nov 14 11:11:37 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:37 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:37 user nova-compute[75255]:       <target dev="tap7492baa9-35"/>
Nov 14 11:11:37 user nova-compute[75255]:     </interface>
Nov 14 11:11:37 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:11:37 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/console.log" append="off"/>
Nov 14 11:11:37 user nova-compute[75255]:     </serial>
Nov 14 11:11:37 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:11:37 user nova-compute[75255]:     <video>
Nov 14 11:11:37 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:37 user nova-compute[75255]:     </video>
Nov 14 11:11:37 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:11:37 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:11:37 user nova-compute[75255]:     </rng>
Nov 14 11:11:37 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:11:37 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:11:37 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:11:37 user nova-compute[75255]:     </memballoon>
Nov 14 11:11:37 user nova-compute[75255]:   </devices>
Nov 14 11:11:37 user nova-compute[75255]: </domain>
Nov 14 11:11:37 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915451133',display_name='tempest-ServerActionsTestOtherA-server-915451133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915451133',id=17,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-dg3had01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=8d0e0752-e32b-4696-abb1-9ca53cae10fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:be:e6,bridge_name='br-int',has_traffic_filtering=True,id=7492baa9-355a-4952-b448-c87d075c46d5,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7492baa9-35') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG os_vif [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:be:e6,bridge_name='br-int',has_traffic_filtering=True,id=7492baa9-355a-4952-b448-c87d075c46d5,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7492baa9-35') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '902537fa-0800-5c4c-bfe1-d9e31ab0f3a7', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7492baa9-35, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7492baa9-35, col_values=(('qos', UUID('41b78224-8c99-4863-bb33-5eb9a3c0c023')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7492baa9-35, col_values=(('external_ids', {'iface-id': '7492baa9-355a-4952-b448-c87d075c46d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:be:e6', 'vm-uuid': '8d0e0752-e32b-4696-abb1-9ca53cae10fc'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:37 user nova-compute[75255]: INFO os_vif [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:be:e6,bridge_name='br-int',has_traffic_filtering=True,id=7492baa9-355a-4952-b448-c87d075c46d5,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7492baa9-35')
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No VIF found with MAC fa:16:3e:d9:be:e6, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updated VIF entry in instance network info cache for port 7492baa9-355a-4952-b448-c87d075c46d5. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG nova.network.neutron [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-15fbcbdb-5398-4433-9112-f63b344e9a42 req-aa34b366-a1a0-4e5d-bd3d-4d2aa8ad03fe service nova] Releasing lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:11:38 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Instance spawned successfully.
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-e462e294-b161-4d6e-9dc6-6646d9fc8015 req-69d28e18-bb0a-4dd8-b00e-796a654757a5 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received event network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e462e294-b161-4d6e-9dc6-6646d9fc8015 req-69d28e18-bb0a-4dd8-b00e-796a654757a5 service nova] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e462e294-b161-4d6e-9dc6-6646d9fc8015 req-69d28e18-bb0a-4dd8-b00e-796a654757a5 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e462e294-b161-4d6e-9dc6-6646d9fc8015 req-69d28e18-bb0a-4dd8-b00e-796a654757a5 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-e462e294-b161-4d6e-9dc6-6646d9fc8015 req-69d28e18-bb0a-4dd8-b00e-796a654757a5 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] No waiting events found dispatching network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:38 user nova-compute[75255]: WARNING nova.compute.manager [req-e462e294-b161-4d6e-9dc6-6646d9fc8015 req-69d28e18-bb0a-4dd8-b00e-796a654757a5 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received unexpected event network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 for instance with vm_state building and task_state spawning.
Nov 14 11:11:38 user nova-compute[75255]: INFO nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:11:38 user nova-compute[75255]: INFO nova.compute.manager [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Took 7.65 seconds to build instance.
Nov 14 11:11:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7eb55140-a614-4c78-bc04-cf4daf843ae6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.847s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updating instance_info_cache with network_info: [{"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-2e186944-c41d-4f07-b852-ff17b2241241" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:11:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-5cc8d46e-bcd7-4bcc-9dfd-71123af1dc4a req-e06387ad-d15c-46e5-b9aa-a3551fb2d73d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5cc8d46e-bcd7-4bcc-9dfd-71123af1dc4a req-e06387ad-d15c-46e5-b9aa-a3551fb2d73d service nova] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5cc8d46e-bcd7-4bcc-9dfd-71123af1dc4a req-e06387ad-d15c-46e5-b9aa-a3551fb2d73d service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5cc8d46e-bcd7-4bcc-9dfd-71123af1dc4a req-e06387ad-d15c-46e5-b9aa-a3551fb2d73d service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-5cc8d46e-bcd7-4bcc-9dfd-71123af1dc4a req-e06387ad-d15c-46e5-b9aa-a3551fb2d73d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] No waiting events found dispatching network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:39 user nova-compute[75255]: WARNING nova.compute.manager [req-5cc8d46e-bcd7-4bcc-9dfd-71123af1dc4a req-e06387ad-d15c-46e5-b9aa-a3551fb2d73d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received unexpected event network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 for instance with vm_state building and task_state spawning.
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:11:41 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Instance spawned successfully.
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:11:41 user nova-compute[75255]: INFO nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-f36f365f-e9aa-4b60-b02f-782ebd3df356 req-21f1e283-1ce5-4513-9967-e85993a6ffcd service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f36f365f-e9aa-4b60-b02f-782ebd3df356 req-21f1e283-1ce5-4513-9967-e85993a6ffcd service nova] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f36f365f-e9aa-4b60-b02f-782ebd3df356 req-21f1e283-1ce5-4513-9967-e85993a6ffcd service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f36f365f-e9aa-4b60-b02f-782ebd3df356 req-21f1e283-1ce5-4513-9967-e85993a6ffcd service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-f36f365f-e9aa-4b60-b02f-782ebd3df356 req-21f1e283-1ce5-4513-9967-e85993a6ffcd service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] No waiting events found dispatching network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:11:41 user nova-compute[75255]: WARNING nova.compute.manager [req-f36f365f-e9aa-4b60-b02f-782ebd3df356 req-21f1e283-1ce5-4513-9967-e85993a6ffcd service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received unexpected event network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 for instance with vm_state building and task_state spawning.
Nov 14 11:11:41 user nova-compute[75255]: INFO nova.compute.manager [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Took 7.47 seconds to build instance.
Nov 14 11:11:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9c093914-e01a-4520-ac25-7d9c58c56a82 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.609s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:42 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea is timed out.
Nov 14 11:11:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully detached device vdb from instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea from the live domain config.
Nov 14 11:11:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxBhFUsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:42 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e6641-90fd-440f-aed9-6f067d08f5dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:11:42 user nova-compute[75255]: No targets found.
Nov 14 11:11:42 user nova-compute[75255]: iSNS:
Nov 14 11:11:42 user nova-compute[75255]: No targets found.
Nov 14 11:11:42 user nova-compute[75255]: STATIC:
Nov 14 11:11:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685
Nov 14 11:11:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f
Nov 14 11:11:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:11:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649
Nov 14 11:11:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:11:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981
Nov 14 11:11:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:42 user nova-compute[75255]: FIRMWARE:
Nov 14 11:11:42 user nova-compute[75255]: No targets found.
Nov 14 11:11:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:11:42 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:11:42 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d052d45-d33b-487f-b153-dff13b49d0db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c93f75-d499-4ea7-a82b-8e825ea3cb5d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 (non-flash)
Nov 14 11:11:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff338371f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981'): ({'sde'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Removing single pathed devices sde {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4445378-ef68-41e1-812f-cc2d103586cc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7e130e-d55a-40eb-988b-b72c9e6e760c]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flushing IO for device /dev/sde {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fcf401-b87a-4b0b-b667-3bc0d12d5170]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ac0e9-fef3-4555-9cfb-34d595a69133]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa0543e-bad6-4a2c-9fd0-4ae9e97478be]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaaa36f-6670-479f-826a-d56c12738b06]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260]
Nov 14 11:11:43 user nova-compute[75255]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981, portal: 172.16.0.220,3260] successful.
Nov 14 11:11:43 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2951755d-901c-4201-807e-ccf0536a2981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2110c106-f957-49af-bd21-4d477ff2a3bd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== disconnect_volume: return (447ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:45 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f2a18b47-e740-4ea5-ad47-85a26c94978f tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.068s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:49 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e is timed out.
Nov 14 11:11:49 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully detached device vdb from instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e from the live domain config.
Nov 14 11:11:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:11:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBvzZJao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:49 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.133s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e84e6c-6506-4c31-9390-15e15c27b521]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:11:50 user nova-compute[75255]: No targets found.
Nov 14 11:11:50 user nova-compute[75255]: iSNS:
Nov 14 11:11:50 user nova-compute[75255]: No targets found.
Nov 14 11:11:50 user nova-compute[75255]: STATIC:
Nov 14 11:11:50 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685
Nov 14 11:11:50 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:50 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:50 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f
Nov 14 11:11:50 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:50 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:50 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e
Nov 14 11:11:50 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:50 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:50 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649
Nov 14 11:11:50 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:50 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:50 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:11:50 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:11:50 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:11:50 user nova-compute[75255]: FIRMWARE:
Nov 14 11:11:50 user nova-compute[75255]: No targets found.
Nov 14 11:11:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:11:50 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:11:50 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d74ec82-8524-454a-ad98-de84799353c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[993da163-c8ed-4668-a2df-a480931449d5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:50 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281e9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[54576de1-8f1f-49c2-a841-6205f22ee678]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d56209e-b6fc-470d-a850-c9ffd769ec71]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcda4f5-a64b-4a2d-88f3-b27c2c6821d2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3054a395-6888-4fa0-9e2b-1de1be451f13]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd12d59-0678-4b27-a817-6d651464436b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e256df-bfe0-4f1c-b9bb-24bd6561a1a6]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260]
Nov 14 11:11:50 user nova-compute[75255]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e, portal: 172.16.0.220,3260] successful.
Nov 14 11:11:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c271a1-ddf7-49f9-a84e-b7034f98515e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff9c703-05c7-4515-9ea0-536062739fc2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== disconnect_volume: return (438ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'flavor' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cda1401-31af-4075-8130-9e5c39268d02 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.289s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:51 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:11:51 user nova-compute[75255]: INFO nova.compute.claims [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Claim successful on node user
Nov 14 11:11:52 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:11:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:11:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:11:52 user nova-compute[75255]: INFO nova.virt.block_device [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Booting with volume db613e9f-f962-4eaf-805c-6801c6686dcd at /dev/vda
Nov 14 11:11:52 user nova-compute[75255]: DEBUG nova.policy [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '382ccde674c04896a70d745cb2da3529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5897376b7cd49f1bd1023adcb84221d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG os_brick.utils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d8557-cb83-4eec-8d1a-51c09ab97a37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9417d62-8c70-490c-a44e-e64378d1fc16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5841f043-2b5f-423f-8704-035af1a38f72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e35d37c-72b6-4cc6-8ae2-7f2cec09f8ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:11:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:11:53 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:11:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c4c56-ab3c-450e-b688-e6c24bf996f6]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG os_brick.utils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updating existing volume attachment record: d8233d50-e4a7-42ca-ae1b-ee44bc9d5cce {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Successfully created port: 237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:11:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Successfully updated port: 237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquired lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.compute.manager [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-changed-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.compute.manager [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Refreshing instance network info cache due to event network-changed-237b1bfe-ef57-4580-9fa8-55ead0cf29fd. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] Acquiring lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updating instance_info_cache with network_info: [{"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Releasing lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance network_info: |[{"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] Acquired lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:11:54 user nova-compute[75255]: DEBUG nova.network.neutron [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Refreshing network info cache for port 237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:11:55 user nova-compute[75255]: DEBUG nova.network.neutron [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updated VIF entry in instance network info cache for port 237b1bfe-ef57-4580-9fa8-55ead0cf29fd. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:11:55 user nova-compute[75255]: DEBUG nova.network.neutron [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updating instance_info_cache with network_info: [{"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:11:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9eef7b24-accd-4c18-b41c-dd943b7a8498 req-78693cee-028b-40bf-83a5-06ef0dd42a65 service nova] Releasing lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:11:57 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Creating image(s)
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Ensure instance console log exists: /opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Start _get_guest_xml network_info=[{"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd8233d50-e4a7-42ca-ae1b-ee44bc9d5cce', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '63b41a9a-238d-49a9-869b-04f93807a162', 'attached_at': '', 'detached_at': '', 'volume_id': 'db613e9f-f962-4eaf-805c-6801c6686dcd', 'serial': 'db613e9f-f962-4eaf-805c-6801c6686dcd'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:11:57 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:57 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:11:57 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:57 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:11:57 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[41688251-5025-434a-a478-dd95bdba182c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:11:57 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[754f37db-5903-4ae6-9484-ff4813d4e8c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd] added
Nov 14 11:11:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7def18-c165-44a1-a380-4e5892b99d9a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e9947e-d8a5-475b-8e48-55e4da010f1f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdNXElHL {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdNXElHL" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8485782a-c9ae-46e6-94ab-fd9c3aa6bd01]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdNXElHL'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[220b6160-1017-4c89-bcb7-8304c93e6d83]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f9d044-751c-4e92-b9fd-02b73f038dd9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2c78f2-8a8a-43a8-aec8-2971a5019327]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]
Nov 14 11:11:57 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.
Nov 14 11:11:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e659fc-c684-44b6-bc08-42b6b0354aba]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb51c5-c27f-46a7-8330-099812fba929]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:11:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:11:57 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:11:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[362acbe6-9d90-4b94-86ae-ba612512d415]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:11:57 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23461396463646633', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461396463646633', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1499633906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1499633906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwU1xv1xc32UMmh521HPmm6gpJwDUhaPj4v1hgrYr86Gslhx3Uank+yCUbau5rZTLI7k7xw1cjFV4LqT2I3ukBAwJ5YycfeR1ZKh0NIzC0EPgZh24zBPEC2vcJeI8HzNA==',key_name='tempest-keypair-1814893210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5897376b7cd49f1bd1023adcb84221d',ramdisk_id='',reservation_id='r-x04jsgts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1203206168',owner_user_name='tempest-ServerActionsV293TestJSON-1203206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='382ccde674c04896a70d745cb2da3529',uuid=63b41a9a-238d-49a9-869b-04f93807a162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converting VIF {"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lazy-loading 'pci_devices' on Instance uuid 63b41a9a-238d-49a9-869b-04f93807a162 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:11:58 user nova-compute[75255]:   <uuid>63b41a9a-238d-49a9-869b-04f93807a162</uuid>
Nov 14 11:11:58 user nova-compute[75255]:   <name>instance-00000012</name>
Nov 14 11:11:58 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:11:58 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:11:58 user nova-compute[75255]:   <metadata>
Nov 14 11:11:58 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:11:58 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:11:58 user nova-compute[75255]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1499633906</nova:name>
Nov 14 11:11:58 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:11:57</nova:creationTime>
Nov 14 11:11:58 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:11:58 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:11:58 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:11:58 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:11:58 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:11:58 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:11:58 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:11:58 user nova-compute[75255]:       <nova:owner>
Nov 14 11:11:58 user nova-compute[75255]:         <nova:user uuid="382ccde674c04896a70d745cb2da3529">tempest-ServerActionsV293TestJSON-1203206168-project-member</nova:user>
Nov 14 11:11:58 user nova-compute[75255]:         <nova:project uuid="f5897376b7cd49f1bd1023adcb84221d">tempest-ServerActionsV293TestJSON-1203206168</nova:project>
Nov 14 11:11:58 user nova-compute[75255]:       </nova:owner>
Nov 14 11:11:58 user nova-compute[75255]:       <nova:ports>
Nov 14 11:11:58 user nova-compute[75255]:         <nova:port uuid="237b1bfe-ef57-4580-9fa8-55ead0cf29fd">
Nov 14 11:11:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 11:11:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:11:58 user nova-compute[75255]:       </nova:ports>
Nov 14 11:11:58 user nova-compute[75255]:     </nova:instance>
Nov 14 11:11:58 user nova-compute[75255]:   </metadata>
Nov 14 11:11:58 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:11:58 user nova-compute[75255]:     <system>
Nov 14 11:11:58 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:11:58 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:11:58 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:11:58 user nova-compute[75255]:       <entry name="serial">63b41a9a-238d-49a9-869b-04f93807a162</entry>
Nov 14 11:11:58 user nova-compute[75255]:       <entry name="uuid">63b41a9a-238d-49a9-869b-04f93807a162</entry>
Nov 14 11:11:58 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:11:58 user nova-compute[75255]:     </system>
Nov 14 11:11:58 user nova-compute[75255]:   </sysinfo>
Nov 14 11:11:58 user nova-compute[75255]:   <os>
Nov 14 11:11:58 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:11:58 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:11:58 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:11:58 user nova-compute[75255]:   </os>
Nov 14 11:11:58 user nova-compute[75255]:   <features>
Nov 14 11:11:58 user nova-compute[75255]:     <acpi/>
Nov 14 11:11:58 user nova-compute[75255]:     <apic/>
Nov 14 11:11:58 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:11:58 user nova-compute[75255]:   </features>
Nov 14 11:11:58 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:11:58 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:11:58 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:11:58 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:11:58 user nova-compute[75255]:   </clock>
Nov 14 11:11:58 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:11:58 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:11:58 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:11:58 user nova-compute[75255]:   </cpu>
Nov 14 11:11:58 user nova-compute[75255]:   <devices>
Nov 14 11:11:58 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:11:58 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:11:58 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:11:58 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:11:58 user nova-compute[75255]:       <serial>db613e9f-f962-4eaf-805c-6801c6686dcd</serial>
Nov 14 11:11:58 user nova-compute[75255]:     </disk>
Nov 14 11:11:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:11:58 user nova-compute[75255]:       <mac address="fa:16:3e:33:b9:f2"/>
Nov 14 11:11:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:11:58 user nova-compute[75255]:       <target dev="tap237b1bfe-ef"/>
Nov 14 11:11:58 user nova-compute[75255]:     </interface>
Nov 14 11:11:58 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:11:58 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162/console.log" append="off"/>
Nov 14 11:11:58 user nova-compute[75255]:     </serial>
Nov 14 11:11:58 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:11:58 user nova-compute[75255]:     <video>
Nov 14 11:11:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:11:58 user nova-compute[75255]:     </video>
Nov 14 11:11:58 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:11:58 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:11:58 user nova-compute[75255]:     </rng>
Nov 14 11:11:58 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:11:58 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:11:58 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:11:58 user nova-compute[75255]:     </memballoon>
Nov 14 11:11:58 user nova-compute[75255]:   </devices>
Nov 14 11:11:58 user nova-compute[75255]: </domain>
Nov 14 11:11:58 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1499633906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1499633906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwU1xv1xc32UMmh521HPmm6gpJwDUhaPj4v1hgrYr86Gslhx3Uank+yCUbau5rZTLI7k7xw1cjFV4LqT2I3ukBAwJ5YycfeR1ZKh0NIzC0EPgZh24zBPEC2vcJeI8HzNA==',key_name='tempest-keypair-1814893210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5897376b7cd49f1bd1023adcb84221d',ramdisk_id='',reservation_id='r-x04jsgts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1203206168',owner_user_name='tempest-ServerActionsV293TestJSON-1203206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='382ccde674c04896a70d745cb2da3529',uuid=63b41a9a-238d-49a9-869b-04f93807a162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converting VIF {"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG os_vif [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95db0e99-ad93-54d8-8851-3303c67b1288', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap237b1bfe-ef, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap237b1bfe-ef, col_values=(('qos', UUID('2dcd2a7c-26b9-4579-b08b-acdcec2777e1')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap237b1bfe-ef, col_values=(('external_ids', {'iface-id': '237b1bfe-ef57-4580-9fa8-55ead0cf29fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:b9:f2', 'vm-uuid': '63b41a9a-238d-49a9-869b-04f93807a162'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:58 user nova-compute[75255]: INFO os_vif [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef')
Nov 14 11:11:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:11:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] No VIF found with MAC fa:16:3e:33:b9:f2, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-e3787d4e-d84c-40d1-b96d-29ec12af061f req-cf69705c-9446-40a1-b490-717d83614b24 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e3787d4e-d84c-40d1-b96d-29ec12af061f req-cf69705c-9446-40a1-b490-717d83614b24 service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e3787d4e-d84c-40d1-b96d-29ec12af061f req-cf69705c-9446-40a1-b490-717d83614b24 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e3787d4e-d84c-40d1-b96d-29ec12af061f req-cf69705c-9446-40a1-b490-717d83614b24 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-e3787d4e-d84c-40d1-b96d-29ec12af061f req-cf69705c-9446-40a1-b490-717d83614b24 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No waiting events found dispatching network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:00 user nova-compute[75255]: WARNING nova.compute.manager [req-e3787d4e-d84c-40d1-b96d-29ec12af061f req-cf69705c-9446-40a1-b490-717d83614b24 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received unexpected event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with vm_state building and task_state spawning.
Nov 14 11:12:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:12:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance spawned successfully.
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-249af8bc-1f4e-4b63-9085-a9f9eb338b55 req-43ab5134-87fa-447d-aded-46f56d81a9cf service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-249af8bc-1f4e-4b63-9085-a9f9eb338b55 req-43ab5134-87fa-447d-aded-46f56d81a9cf service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-249af8bc-1f4e-4b63-9085-a9f9eb338b55 req-43ab5134-87fa-447d-aded-46f56d81a9cf service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-249af8bc-1f4e-4b63-9085-a9f9eb338b55 req-43ab5134-87fa-447d-aded-46f56d81a9cf service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-249af8bc-1f4e-4b63-9085-a9f9eb338b55 req-43ab5134-87fa-447d-aded-46f56d81a9cf service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No waiting events found dispatching network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:02 user nova-compute[75255]: WARNING nova.compute.manager [req-249af8bc-1f4e-4b63-9085-a9f9eb338b55 req-43ab5134-87fa-447d-aded-46f56d81a9cf service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received unexpected event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with vm_state building and task_state spawning.
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:12:02 user nova-compute[75255]: INFO nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 14 11:12:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:12:02 user nova-compute[75255]: INFO nova.compute.manager [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Took 10.88 seconds to build instance.
Nov 14 11:12:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a0e20dd0-dad9-4623-9dc7-c4bf95a25fad tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.978s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Port 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf binding to destination host user is already ACTIVE {{(pid=75255) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:11 user nova-compute[75255]: INFO nova.compute.manager [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Terminating instance
Nov 14 11:12:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-27d94b43-8189-4c15-b8a9-946b87945dee req-ce29ce9f-c198-4cec-8fad-59e1350d6a0e service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-vif-unplugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-27d94b43-8189-4c15-b8a9-946b87945dee req-ce29ce9f-c198-4cec-8fad-59e1350d6a0e service nova] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-27d94b43-8189-4c15-b8a9-946b87945dee req-ce29ce9f-c198-4cec-8fad-59e1350d6a0e service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-27d94b43-8189-4c15-b8a9-946b87945dee req-ce29ce9f-c198-4cec-8fad-59e1350d6a0e service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-27d94b43-8189-4c15-b8a9-946b87945dee req-ce29ce9f-c198-4cec-8fad-59e1350d6a0e service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] No waiting events found dispatching network-vif-unplugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-27d94b43-8189-4c15-b8a9-946b87945dee req-ce29ce9f-c198-4cec-8fad-59e1350d6a0e service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-vif-unplugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Creating tmpfile /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/tmp4s37t57v to verify with other compute node that the instance is on the same shared storage. {{(pid=75255) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Instance destroyed successfully.
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'resources' on Instance uuid 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1544469479',display_name='tempest-AttachVolumeNegativeTest-server-1544469479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1544469479',id=4,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC5AfALzTEcMOMPPjP1RRWQSRQv6xwe4qIJZu4lq1OD/RdKjscUhWi11xtMLgh/IuqwEeuXVq2am6ZUU50GOc/dGAvfbXswxCM1uqDJhF5qA7yubJMa0fqK2xaP19YFgw==',key_name='tempest-keypair-1461427568',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:06:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-8008q8r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=55b1ffe7-9be4-4ff1-9ed7-559cf6270eea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "address": "fa:16:3e:87:f3:6b", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b74d75-61", "ovs_interfaceid": "a7b74d75-61f6-40f3-bd68-04c50de0c3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:f3:6b,bridge_name='br-int',has_traffic_filtering=True,id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b74d75-61') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG os_vif [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f3:6b,bridge_name='br-int',has_traffic_filtering=True,id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b74d75-61') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7b74d75-61, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e1432fe-0806-4fe5-ae55-39542cb6f026) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: INFO os_vif [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f3:6b,bridge_name='br-int',has_traffic_filtering=True,id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b74d75-61')
Nov 14 11:12:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Deleting instance files /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea_del
Nov 14 11:12:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Deletion of /opt/stack/data/nova/instances/55b1ffe7-9be4-4ff1-9ed7-559cf6270eea_del complete
Nov 14 11:12:12 user nova-compute[75255]: INFO nova.compute.manager [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 11:12:12 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance destroyed successfully.
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lazy-loading 'resources' on Instance uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG os_vif [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8730dcdf-d2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cf18306-2d31-4346-9ee4-16d12d2f6290) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:12 user nova-compute[75255]: INFO os_vif [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2')
Nov 14 11:12:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:12:12 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:12:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:12:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bcb11f-b646-4001-8290-116f0b2f2bb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:12:13 user nova-compute[75255]: No targets found.
Nov 14 11:12:13 user nova-compute[75255]: iSNS:
Nov 14 11:12:13 user nova-compute[75255]: No targets found.
Nov 14 11:12:13 user nova-compute[75255]: STATIC:
Nov 14 11:12:13 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:12:13 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:13 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:13 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685
Nov 14 11:12:13 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:13 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:13 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f
Nov 14 11:12:13 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:13 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:13 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649
Nov 14 11:12:13 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:13 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:13 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:12:13 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:13 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:13 user nova-compute[75255]: FIRMWARE:
Nov 14 11:12:13 user nova-compute[75255]: No targets found.
Nov 14 11:12:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:12:13 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:12:13 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc307c7-ebbc-41d9-8177-19d3de179adf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[95702763-338e-48f5-9d46-66d534421670]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:13 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3286c2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce0ff6-6455-48a8-81b0-72d8c691a8d0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9732c197-ebb1-4a71-b1c3-a6863d0938b7]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90406b8-e707-4aef-b065-6f389574359d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e40fdba-2487-451f-88b9-87ab18e414e7]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[915be67a-6950-4040-902d-c3cfb3bd2e35]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e21ca7c-b852-4e8a-ac5e-3165fd15a2e3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]
Nov 14 11:12:13 user nova-compute[75255]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.
Nov 14 11:12:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2299becb-4035-4819-97d8-9d4b762bcfb4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== disconnect_volume: return (324ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:13 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Took 0.70 seconds to deallocate network for instance.
Nov 14 11:12:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-75f0f619-bb7c-44ff-917b-a3ddd36da861 req-c6622ae7-b126-443b-b7ce-adc32967ac53 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-vif-deleted-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:13 user nova-compute[75255]: INFO nova.compute.manager [req-75f0f619-bb7c-44ff-917b-a3ddd36da861 req-c6622ae7-b126-443b-b7ce-adc32967ac53 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Neutron deleted interface a7b74d75-61f6-40f3-bd68-04c50de0c3b3; detaching it from the instance and deleting it from the info cache
Nov 14 11:12:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-75f0f619-bb7c-44ff-917b-a3ddd36da861 req-c6622ae7-b126-443b-b7ce-adc32967ac53 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-75f0f619-bb7c-44ff-917b-a3ddd36da861 req-c6622ae7-b126-443b-b7ce-adc32967ac53 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Detach interface failed, port_id=a7b74d75-61f6-40f3-bd68-04c50de0c3b3, reason: Instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:13 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Deleted allocations for instance 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea
Nov 14 11:12:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6f7c116b-c3b8-42a8-af9b-33c285b06c92 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received event network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Acquiring lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Lock "55b1ffe7-9be4-4ff1-9ed7-559cf6270eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] No waiting events found dispatching network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:14 user nova-compute[75255]: WARNING nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 55b1ffe7-9be4-4ff1-9ed7-559cf6270eea] Received unexpected event network-vif-plugged-a7b74d75-61f6-40f3-bd68-04c50de0c3b3 for instance with vm_state deleted and task_state None.
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:14 user nova-compute[75255]: WARNING nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state resized and task_state resize_reverting.
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:14 user nova-compute[75255]: WARNING nova.compute.manager [req-b285cc4d-c472-40bc-943d-91c0a1733fef req-849abf42-dcd7-4ef3-8795-21b974d245d0 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state resized and task_state resize_reverting.
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lazy-loading 'migration_context' on Instance uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.objects.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Object Instance<26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c> lazy-loaded attributes: resources,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:12:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.358s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:14 user nova-compute[75255]: INFO nova.compute.manager [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Swapping old allocation on dict_keys(['f0f4b442-5a89-43dd-b8f0-d063e03c0c97']) held by migration f25766aa-a2ee-4894-9983-8a2721132a98 for instance
Nov 14 11:12:14 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Overwriting current allocation {'allocations': {'f0f4b442-5a89-43dd-b8f0-d063e03c0c97': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': '7b3a9d5daf4b497a8a85e435e91f1727', 'user_id': 'a6cafcd6055544bcbd86f3015db594f2', 'consumer_generation': 1} on consumer 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquired lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Releasing lock "refresh_cache-26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG os_brick.utils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8de91b-a399-4ffc-a132-abc8f855f0b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b6ab0-00c7-43a5-8ba1-7bd81a5793f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc53516-901d-4c06-b580-3478ce20622f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a4e7f7-b8d9-4702-b32d-c605eb1a484b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:12:15 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:12:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a7e80c-c136-4943-b864-96a2e6e9e352]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:12:15 user nova-compute[75255]: DEBUG os_brick.utils [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:12:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Starting finish_revert_migration {{(pid=75255) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Start _get_guest_xml network_info=[{"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '2a5f0a0b-e795-47c6-9ee8-3bd043eddd2c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c', 'attached_at': '2023-11-14T11:12:20.000000', 'detached_at': '', 'volume_id': '4655b965-55d1-4c75-af86-8a8caabfe655', 'serial': '4655b965-55d1-4c75-af86-8a8caabfe655'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:12:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:12:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:12:20 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:12:20 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:12:20 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e023e2-67bb-4f35-b66b-18b460a23f6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:12:20 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[808c0358-005b-42a5-ba61-1184edb17ea4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655] added
Nov 14 11:12:20 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc633d-9ef6-45d0-a68d-60fb2da34ddb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d93ba0-cf85-49f5-8180-55e38fa3ae91]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXFtywBY {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXFtywBY" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe9980-a132-418b-8a4c-ba6a5923b0a6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXFtywBY'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[645fccf1-cc3e-43e9-9adc-f23ad97bea65]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f099d5-dc89-4576-baa9-fafe03351ee9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:20 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:20 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[79384c58-8454-4cad-b14a-dd38291f7218]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]
Nov 14 11:12:20 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.
Nov 14 11:12:20 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ab875-7e23-487c-bfb3-251120c1a32d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb71350-3291-48fd-ae2d-1bb4636226d8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:20 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:20 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e88af-ac91-461c-9890-5f26dc567a4e]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:12:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26139306333326364', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139306333326364', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:12:21 user nova-compute[75255]:   <uuid>26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</uuid>
Nov 14 11:12:21 user nova-compute[75255]:   <name>instance-00000003</name>
Nov 14 11:12:21 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:12:21 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:12:21 user nova-compute[75255]:   <metadata>
Nov 14 11:12:21 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:12:21 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:12:21 user nova-compute[75255]:       <nova:name>tempest-ServerActionsTestOtherB-server-1199255564</nova:name>
Nov 14 11:12:21 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:12:20</nova:creationTime>
Nov 14 11:12:21 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:12:21 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:12:21 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:12:21 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:12:21 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:12:21 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:12:21 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:12:21 user nova-compute[75255]:       <nova:owner>
Nov 14 11:12:21 user nova-compute[75255]:         <nova:user uuid="a6cafcd6055544bcbd86f3015db594f2">tempest-ServerActionsTestOtherB-1009587932-project-member</nova:user>
Nov 14 11:12:21 user nova-compute[75255]:         <nova:project uuid="7b3a9d5daf4b497a8a85e435e91f1727">tempest-ServerActionsTestOtherB-1009587932</nova:project>
Nov 14 11:12:21 user nova-compute[75255]:       </nova:owner>
Nov 14 11:12:21 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:12:21 user nova-compute[75255]:       <nova:ports>
Nov 14 11:12:21 user nova-compute[75255]:         <nova:port uuid="8730dcdf-d2cb-4be1-aa6a-299cb1b955bf">
Nov 14 11:12:21 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:12:21 user nova-compute[75255]:         </nova:port>
Nov 14 11:12:21 user nova-compute[75255]:       </nova:ports>
Nov 14 11:12:21 user nova-compute[75255]:     </nova:instance>
Nov 14 11:12:21 user nova-compute[75255]:   </metadata>
Nov 14 11:12:21 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:12:21 user nova-compute[75255]:     <system>
Nov 14 11:12:21 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:12:21 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:12:21 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:12:21 user nova-compute[75255]:       <entry name="serial">26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</entry>
Nov 14 11:12:21 user nova-compute[75255]:       <entry name="uuid">26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c</entry>
Nov 14 11:12:21 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:12:21 user nova-compute[75255]:     </system>
Nov 14 11:12:21 user nova-compute[75255]:   </sysinfo>
Nov 14 11:12:21 user nova-compute[75255]:   <os>
Nov 14 11:12:21 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:12:21 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:12:21 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:12:21 user nova-compute[75255]:   </os>
Nov 14 11:12:21 user nova-compute[75255]:   <features>
Nov 14 11:12:21 user nova-compute[75255]:     <acpi/>
Nov 14 11:12:21 user nova-compute[75255]:     <apic/>
Nov 14 11:12:21 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:12:21 user nova-compute[75255]:   </features>
Nov 14 11:12:21 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:12:21 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:12:21 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:12:21 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:12:21 user nova-compute[75255]:   </clock>
Nov 14 11:12:21 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:12:21 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:12:21 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:12:21 user nova-compute[75255]:   </cpu>
Nov 14 11:12:21 user nova-compute[75255]:   <devices>
Nov 14 11:12:21 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:12:21 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:12:21 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk"/>
Nov 14 11:12:21 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:12:21 user nova-compute[75255]:     </disk>
Nov 14 11:12:21 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:12:21 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:12:21 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:12:21 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:12:21 user nova-compute[75255]:       <serial>4655b965-55d1-4c75-af86-8a8caabfe655</serial>
Nov 14 11:12:21 user nova-compute[75255]:     </disk>
Nov 14 11:12:21 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:12:21 user nova-compute[75255]:       <mac address="fa:16:3e:47:a1:19"/>
Nov 14 11:12:21 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:12:21 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:12:21 user nova-compute[75255]:       <target dev="tap8730dcdf-d2"/>
Nov 14 11:12:21 user nova-compute[75255]:     </interface>
Nov 14 11:12:21 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:12:21 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/console.log" append="off"/>
Nov 14 11:12:21 user nova-compute[75255]:     </serial>
Nov 14 11:12:21 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:12:21 user nova-compute[75255]:     <video>
Nov 14 11:12:21 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:12:21 user nova-compute[75255]:     </video>
Nov 14 11:12:21 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:12:21 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:12:21 user nova-compute[75255]:     </rng>
Nov 14 11:12:21 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:12:21 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:12:21 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:12:21 user nova-compute[75255]:     </memballoon>
Nov 14 11:12:21 user nova-compute[75255]:   </devices>
Nov 14 11:12:21 user nova-compute[75255]: </domain>
Nov 14 11:12:21 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG os_vif [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac70d005-d2cb-57f9-84aa-74991961abd8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8730dcdf-d2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8730dcdf-d2, col_values=(('qos', UUID('f0147011-a30a-4806-88f3-c0d009d2df41')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8730dcdf-d2, col_values=(('external_ids', {'iface-id': '8730dcdf-d2cb-4be1-aa6a-299cb1b955bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:a1:19', 'vm-uuid': '26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: INFO os_vif [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2')
Nov 14 11:12:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:21 user nova-compute[75255]: INFO nova.compute.manager [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Terminating instance
Nov 14 11:12:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-708adf78-439b-4e01-bfdc-0da4e193b7dd req-9dc1d48f-2a76-4d38-8a44-480aa37f9f65 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-unplugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-708adf78-439b-4e01-bfdc-0da4e193b7dd req-9dc1d48f-2a76-4d38-8a44-480aa37f9f65 service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-708adf78-439b-4e01-bfdc-0da4e193b7dd req-9dc1d48f-2a76-4d38-8a44-480aa37f9f65 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-708adf78-439b-4e01-bfdc-0da4e193b7dd req-9dc1d48f-2a76-4d38-8a44-480aa37f9f65 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-708adf78-439b-4e01-bfdc-0da4e193b7dd req-9dc1d48f-2a76-4d38-8a44-480aa37f9f65 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-unplugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-708adf78-439b-4e01-bfdc-0da4e193b7dd req-9dc1d48f-2a76-4d38-8a44-480aa37f9f65 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-unplugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Instance destroyed successfully.
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'resources' on Instance uuid 844fb83b-7dc0-4720-bacc-52917c1d3c6e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1740956480',display_name='tempest-TestMinimumBasicScenario-server-1740956480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1740956480',id=10,image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLubt+BEWN8kJ36V2h8+qu0AjZ1e+g52jEBZdUEat+zmfnZ0m8vxRP4cgbi6UlWVTZdExaSwyq7eCW1mS1l8yvsQy2f7NujuxCqk0iCfPN5M+6iuUYikHric6nqTEkCMkA==',key_name='tempest-TestMinimumBasicScenario-1185292113',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-cmi4zxzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b185a70-d273-40c7-a522-1f344ff8db74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:09:43Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=844fb83b-7dc0-4720-bacc-52917c1d3c6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "b13a195e-5614-4f79-8037-b0a124f021dc", "address": "fa:16:3e:98:94:4b", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13a195e-56", "ovs_interfaceid": "b13a195e-5614-4f79-8037-b0a124f021dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG os_vif [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb13a195e-56, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82cdd2f2-bd52-4697-83e9-84c5ce95b553) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: INFO os_vif [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:94:4b,bridge_name='br-int',has_traffic_filtering=True,id=b13a195e-5614-4f79-8037-b0a124f021dc,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13a195e-56')
Nov 14 11:12:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Deleting instance files /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e_del
Nov 14 11:12:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Deletion of /opt/stack/data/nova/instances/844fb83b-7dc0-4720-bacc-52917c1d3c6e_del complete
Nov 14 11:12:23 user nova-compute[75255]: INFO nova.compute.manager [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:23 user nova-compute[75255]: INFO nova.compute.manager [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Terminating instance
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-bfb1045f-bdd9-49f4-8b8e-009eb91ec5d3 req-a3f0dfb5-2059-4393-95af-d2dc5929c1a5 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bfb1045f-bdd9-49f4-8b8e-009eb91ec5d3 req-a3f0dfb5-2059-4393-95af-d2dc5929c1a5 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bfb1045f-bdd9-49f4-8b8e-009eb91ec5d3 req-a3f0dfb5-2059-4393-95af-d2dc5929c1a5 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bfb1045f-bdd9-49f4-8b8e-009eb91ec5d3 req-a3f0dfb5-2059-4393-95af-d2dc5929c1a5 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-bfb1045f-bdd9-49f4-8b8e-009eb91ec5d3 req-a3f0dfb5-2059-4393-95af-d2dc5929c1a5 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:23 user nova-compute[75255]: WARNING nova.compute.manager [req-bfb1045f-bdd9-49f4-8b8e-009eb91ec5d3 req-a3f0dfb5-2059-4393-95af-d2dc5929c1a5 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state resized and task_state resize_reverting.
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:24 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Took 0.89 seconds to deallocate network for instance.
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-f0715f1c-891d-49c1-834a-cf697a4b9d79 req-368de211-3b80-4e9a-ad64-c1c751b63b93 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f0715f1c-891d-49c1-834a-cf697a4b9d79 req-368de211-3b80-4e9a-ad64-c1c751b63b93 service nova] Acquiring lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f0715f1c-891d-49c1-834a-cf697a4b9d79 req-368de211-3b80-4e9a-ad64-c1c751b63b93 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f0715f1c-891d-49c1-834a-cf697a4b9d79 req-368de211-3b80-4e9a-ad64-c1c751b63b93 service nova] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-f0715f1c-891d-49c1-834a-cf697a4b9d79 req-368de211-3b80-4e9a-ad64-c1c751b63b93 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] No waiting events found dispatching network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:24 user nova-compute[75255]: WARNING nova.compute.manager [req-f0715f1c-891d-49c1-834a-cf697a4b9d79 req-368de211-3b80-4e9a-ad64-c1c751b63b93 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received unexpected event network-vif-plugged-b13a195e-5614-4f79-8037-b0a124f021dc for instance with vm_state deleted and task_state None.
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-f0715f1c-891d-49c1-834a-cf697a4b9d79 req-368de211-3b80-4e9a-ad64-c1c751b63b93 service nova] [instance: 844fb83b-7dc0-4720-bacc-52917c1d3c6e] Received event network-vif-deleted-b13a195e-5614-4f79-8037-b0a124f021dc {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-23031675-ba9f-4619-a307-0708ca30d104 req-b91ead22-bba5-4b68-91c6-950b95c85109 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-vif-unplugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-23031675-ba9f-4619-a307-0708ca30d104 req-b91ead22-bba5-4b68-91c6-950b95c85109 service nova] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-23031675-ba9f-4619-a307-0708ca30d104 req-b91ead22-bba5-4b68-91c6-950b95c85109 service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-23031675-ba9f-4619-a307-0708ca30d104 req-b91ead22-bba5-4b68-91c6-950b95c85109 service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-23031675-ba9f-4619-a307-0708ca30d104 req-b91ead22-bba5-4b68-91c6-950b95c85109 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] No waiting events found dispatching network-vif-unplugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-23031675-ba9f-4619-a307-0708ca30d104 req-b91ead22-bba5-4b68-91c6-950b95c85109 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-vif-unplugged-835970ab-7fbc-40e7-aa3d-7301d32d936e for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Instance destroyed successfully.
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lazy-loading 'resources' on Instance uuid 2e186944-c41d-4f07-b852-ff17b2241241 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1356594912',display_name='tempest-VolumesAdminNegativeTest-server-1356594912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1356594912',id=5,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdEweCIKninRK6dS7x3JfC4ui+pVgotMlL5HAeo5WX2If/zjnYxWKp59yRleNcazS5Wh+XJCEpNCJwDIFULT1y59Dq4MwDD7kpBNN8S22yCy+Gh1dpJOkR8HcDhyqmAeA==',key_name='tempest-keypair-1124603066',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea68b5a52247427da8880074883a4ce6',ramdisk_id='',reservation_id='r-drq9yih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-222875096',owner_user_name='tempest-VolumesAdminNegativeTest-222875096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52279ec6cb8044ad9b7b81808b7631dd',uuid=2e186944-c41d-4f07-b852-ff17b2241241,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converting VIF {"id": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "address": "fa:16:3e:6c:b1:bc", "network": {"id": "64db290e-fd62-4c8e-9896-0d11d1de6355", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1296421166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea68b5a52247427da8880074883a4ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835970ab-7f", "ovs_interfaceid": "835970ab-7fbc-40e7-aa3d-7301d32d936e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b1:bc,bridge_name='br-int',has_traffic_filtering=True,id=835970ab-7fbc-40e7-aa3d-7301d32d936e,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835970ab-7f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG os_vif [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b1:bc,bridge_name='br-int',has_traffic_filtering=True,id=835970ab-7fbc-40e7-aa3d-7301d32d936e,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835970ab-7f') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap835970ab-7f, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71504454-96a3-45dd-a063-91aefa2d75d0) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:24 user nova-compute[75255]: INFO os_vif [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b1:bc,bridge_name='br-int',has_traffic_filtering=True,id=835970ab-7fbc-40e7-aa3d-7301d32d936e,network=Network(64db290e-fd62-4c8e-9896-0d11d1de6355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835970ab-7f')
Nov 14 11:12:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Deleting instance files /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241_del
Nov 14 11:12:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Deletion of /opt/stack/data/nova/instances/2e186944-c41d-4f07-b852-ff17b2241241_del complete
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:24 user nova-compute[75255]: INFO nova.compute.manager [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:12:24 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:12:24 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Deleted allocations for instance 844fb83b-7dc0-4720-bacc-52917c1d3c6e
Nov 14 11:12:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6d56aa81-34dd-490c-b4bf-1f71042e11e6 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "844fb83b-7dc0-4720-bacc-52917c1d3c6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:25 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Took 0.70 seconds to deallocate network for instance.
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:25 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Deleted allocations for instance 2e186944-c41d-4f07-b852-ff17b2241241
Nov 14 11:12:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1bcf6d68-ad1d-4589-924b-15ae40946731 tempest-VolumesAdminNegativeTest-222875096 tempest-VolumesAdminNegativeTest-222875096-project-member] Lock "2e186944-c41d-4f07-b852-ff17b2241241" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.097s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance running successfully.
Nov 14 11:12:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] finish_revert_migration finished successfully. {{(pid=75255) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-74af069f-a8e6-499d-9b69-e666a37d63b3 req-bcaf12c8-27e1-48f6-9ac1-c34458e4f111 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-74af069f-a8e6-499d-9b69-e666a37d63b3 req-bcaf12c8-27e1-48f6-9ac1-c34458e4f111 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-74af069f-a8e6-499d-9b69-e666a37d63b3 req-bcaf12c8-27e1-48f6-9ac1-c34458e4f111 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-74af069f-a8e6-499d-9b69-e666a37d63b3 req-bcaf12c8-27e1-48f6-9ac1-c34458e4f111 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-74af069f-a8e6-499d-9b69-e666a37d63b3 req-bcaf12c8-27e1-48f6-9ac1-c34458e4f111 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:25 user nova-compute[75255]: WARNING nova.compute.manager [req-74af069f-a8e6-499d-9b69-e666a37d63b3 req-bcaf12c8-27e1-48f6-9ac1-c34458e4f111 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state resized and task_state resize_reverting.
Nov 14 11:12:25 user nova-compute[75255]: INFO nova.compute.manager [None req-0fdeef27-c11a-4ad0-87d1-ffd9c5688110 tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance to original state: 'active'
Nov 14 11:12:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-258048e5-3790-4327-be99-f334b2572fbd req-3a9dc3eb-1245-4aa2-bfed-99691e32fcb4 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-vif-deleted-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-a4a36fa5-2b83-4531-8059-cb56405bcd31 req-c4e02033-45a0-4acb-b170-9f4573ddc430 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received event network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a4a36fa5-2b83-4531-8059-cb56405bcd31 req-c4e02033-45a0-4acb-b170-9f4573ddc430 service nova] Acquiring lock "2e186944-c41d-4f07-b852-ff17b2241241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a4a36fa5-2b83-4531-8059-cb56405bcd31 req-c4e02033-45a0-4acb-b170-9f4573ddc430 service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a4a36fa5-2b83-4531-8059-cb56405bcd31 req-c4e02033-45a0-4acb-b170-9f4573ddc430 service nova] Lock "2e186944-c41d-4f07-b852-ff17b2241241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-a4a36fa5-2b83-4531-8059-cb56405bcd31 req-c4e02033-45a0-4acb-b170-9f4573ddc430 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] No waiting events found dispatching network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:26 user nova-compute[75255]: WARNING nova.compute.manager [req-a4a36fa5-2b83-4531-8059-cb56405bcd31 req-c4e02033-45a0-4acb-b170-9f4573ddc430 service nova] [instance: 2e186944-c41d-4f07-b852-ff17b2241241] Received unexpected event network-vif-plugged-835970ab-7fbc-40e7-aa3d-7301d32d936e for instance with vm_state deleted and task_state None.
Nov 14 11:12:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:12:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7867MB free_disk=25.44540023803711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1b608f6b-e6ae-4530-8f05-05871ebace54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 63b41a9a-238d-49a9-869b-04f93807a162 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:12:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:12:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:12:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:12:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_power_states {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 1b608f6b-e6ae-4530-8f05-05871ebace54 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 24e046fb-04f4-49f8-bfa8-951334e25e5f {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 8d0e0752-e32b-4696-abb1-9ca53cae10fc {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 63b41a9a-238d-49a9-869b-04f93807a162 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "66031f17-4225-4c50-bd18-3df496586023" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "63b41a9a-238d-49a9-869b-04f93807a162" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "66031f17-4225-4c50-bd18-3df496586023" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "63b41a9a-238d-49a9-869b-04f93807a162" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-changed-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing instance network info cache due to event network-changed-b809feb7-2144-4123-8de8-43451d6ec258. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:12:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] Acquiring lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:12:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] Acquired lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:12:48 user nova-compute[75255]: DEBUG nova.network.neutron [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Refreshing network info cache for port b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:12:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:49 user nova-compute[75255]: DEBUG nova.network.neutron [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updated VIF entry in instance network info cache for port b809feb7-2144-4123-8de8-43451d6ec258. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:12:49 user nova-compute[75255]: DEBUG nova.network.neutron [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [{"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e1f22ccb-0c00-4f34-a57b-68d8dae19d67 req-78b6aa01-1a52-4775-b33e-0ee9d16894ed service nova] Releasing lock "refresh_cache-1b608f6b-e6ae-4530-8f05-05871ebace54" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:12:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:51 user nova-compute[75255]: INFO nova.compute.manager [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Terminating instance
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-c211be58-e840-4458-b1e0-fd83b0541fcc req-ffe58084-068f-4a0d-853f-c8660f5ade8c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c211be58-e840-4458-b1e0-fd83b0541fcc req-ffe58084-068f-4a0d-853f-c8660f5ade8c service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c211be58-e840-4458-b1e0-fd83b0541fcc req-ffe58084-068f-4a0d-853f-c8660f5ade8c service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c211be58-e840-4458-b1e0-fd83b0541fcc req-ffe58084-068f-4a0d-853f-c8660f5ade8c service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-c211be58-e840-4458-b1e0-fd83b0541fcc req-ffe58084-068f-4a0d-853f-c8660f5ade8c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-unplugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-c211be58-e840-4458-b1e0-fd83b0541fcc req-ffe58084-068f-4a0d-853f-c8660f5ade8c service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-b809feb7-2144-4123-8de8-43451d6ec258 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-25f02eb8-9c36-46d6-8569-72eb8c7a6203 req-d66bdb2e-9158-4277-a2cd-096e024ab91d service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-25f02eb8-9c36-46d6-8569-72eb8c7a6203 req-d66bdb2e-9158-4277-a2cd-096e024ab91d service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-25f02eb8-9c36-46d6-8569-72eb8c7a6203 req-d66bdb2e-9158-4277-a2cd-096e024ab91d service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-25f02eb8-9c36-46d6-8569-72eb8c7a6203 req-d66bdb2e-9158-4277-a2cd-096e024ab91d service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-25f02eb8-9c36-46d6-8569-72eb8c7a6203 req-d66bdb2e-9158-4277-a2cd-096e024ab91d service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-unplugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-25f02eb8-9c36-46d6-8569-72eb8c7a6203 req-d66bdb2e-9158-4277-a2cd-096e024ab91d service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-7e6ff10a-2c6c-4277-acd5-7f49d7ade8a5 req-a63c8c2e-9093-40e1-8a8d-aa913aa0005d service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e6ff10a-2c6c-4277-acd5-7f49d7ade8a5 req-a63c8c2e-9093-40e1-8a8d-aa913aa0005d service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e6ff10a-2c6c-4277-acd5-7f49d7ade8a5 req-a63c8c2e-9093-40e1-8a8d-aa913aa0005d service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e6ff10a-2c6c-4277-acd5-7f49d7ade8a5 req-a63c8c2e-9093-40e1-8a8d-aa913aa0005d service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-7e6ff10a-2c6c-4277-acd5-7f49d7ade8a5 req-a63c8c2e-9093-40e1-8a8d-aa913aa0005d service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-unplugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-7e6ff10a-2c6c-4277-acd5-7f49d7ade8a5 req-a63c8c2e-9093-40e1-8a8d-aa913aa0005d service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-5ad47315-5fa1-4867-bb4b-087b246d1751 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Instance destroyed successfully.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lazy-loading 'resources' on Instance uuid 1b608f6b-e6ae-4530-8f05-05871ebace54 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "b809feb7-2144-4123-8de8-43451d6ec258", "address": "fa:16:3e:5f:9a:5d", "network": {"id": "b19d91dd-285e-45f8-bbe4-d04b2bbddce7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-705527113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb809feb7-21", "ovs_interfaceid": "b809feb7-2144-4123-8de8-43451d6ec258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9a:5d,bridge_name='br-int',has_traffic_filtering=True,id=b809feb7-2144-4123-8de8-43451d6ec258,network=Network(b19d91dd-285e-45f8-bbe4-d04b2bbddce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb809feb7-21') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9a:5d,bridge_name='br-int',has_traffic_filtering=True,id=b809feb7-2144-4123-8de8-43451d6ec258,network=Network(b19d91dd-285e-45f8-bbe4-d04b2bbddce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb809feb7-21') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb809feb7-21, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc6eff95-969b-449b-9171-31b1230894c5) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9a:5d,bridge_name='br-int',has_traffic_filtering=True,id=b809feb7-2144-4123-8de8-43451d6ec258,network=Network(b19d91dd-285e-45f8-bbe4-d04b2bbddce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb809feb7-21')
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:df:ed,bridge_name='br-int',has_traffic_filtering=True,id=ab2e7ac9-e023-4327-9b99-e33b65e1ffed,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab2e7ac9-e0') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:df:ed,bridge_name='br-int',has_traffic_filtering=True,id=ab2e7ac9-e023-4327-9b99-e33b65e1ffed,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab2e7ac9-e0') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab2e7ac9-e0, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6998c27-603d-44c9-90d6-0ef3bd0d5a30) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:df:ed,bridge_name='br-int',has_traffic_filtering=True,id=ab2e7ac9-e023-4327-9b99-e33b65e1ffed,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab2e7ac9-e0')
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:e0,bridge_name='br-int',has_traffic_filtering=True,id=5ad47315-5fa1-4867-bb4b-087b246d1751,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ad47315-5f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:e0,bridge_name='br-int',has_traffic_filtering=True,id=5ad47315-5fa1-4867-bb4b-087b246d1751,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ad47315-5f') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ad47315-5f, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c16eef9a-b24b-4f9b-be2f-0f4ad331f069) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:e0,bridge_name='br-int',has_traffic_filtering=True,id=5ad47315-5fa1-4867-bb4b-087b246d1751,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ad47315-5f')
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed2cf92-6f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed2cf92-6f') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ed2cf92-6f, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0fc0247-256d-4aa1-b66a-1caf07373745) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:c1,bridge_name='br-int',has_traffic_filtering=True,id=4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed2cf92-6f')
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:bf:69,bridge_name='br-int',has_traffic_filtering=True,id=5578eb30-f8cc-4113-943f-ec533b734589,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5578eb30-f8') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:bf:69,bridge_name='br-int',has_traffic_filtering=True,id=5578eb30-f8cc-4113-943f-ec533b734589,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5578eb30-f8') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5578eb30-f8, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=357c2b7f-61a3-4979-a718-8c8497efb15a) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:bf:69,bridge_name='br-int',has_traffic_filtering=True,id=5578eb30-f8cc-4113-943f-ec533b734589,network=Network(8350a163-1d44-4772-b9b7-32d581e17afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5578eb30-f8')
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=9e99fa23-783f-4c65-8a2b-4e62f2636047,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e99fa23-78') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=9e99fa23-783f-4c65-8a2b-4e62f2636047,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e99fa23-78') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e99fa23-78, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edbfc433-ad7f-4095-82a1-cd330e8e27ac) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=9e99fa23-783f-4c65-8a2b-4e62f2636047,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e99fa23-78')
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T11:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664434946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664434946',id=15,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPic/3SktrTGMstm5Ca66fpj/60pbwRH9nogil2BR5mzJuQS6VWT9eBHgfT0MQlLdBfotmnNCwEe0Al6Zi1PrhWxwwV+hsG+GC6K9EG2+Aw8t0BkZJja9P1NBNk0E0fGow==',key_name='tempest-keypair-769657102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ae70ce6a6c46a5a7558971f96ddf5e',ramdisk_id='',reservation_id='r-j8zz0ums',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1557158929',owner_user_name='tempest-TaggedBootDevicesTest_v242-1557158929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed1e0e782ec1411bae848a63a9e76c72',uuid=1b608f6b-e6ae-4530-8f05-05871ebace54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converting VIF {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:9a:1d,bridge_name='br-int',has_traffic_filtering=True,id=51e526ad-60cb-4071-bc74-a01406b3571e,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e526ad-60') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:9a:1d,bridge_name='br-int',has_traffic_filtering=True,id=51e526ad-60cb-4071-bc74-a01406b3571e,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e526ad-60') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51e526ad-60, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de664c8d-6e3a-4782-b1af-4c27349ba52c) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:53 user nova-compute[75255]: INFO os_vif [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:9a:1d,bridge_name='br-int',has_traffic_filtering=True,id=51e526ad-60cb-4071-bc74-a01406b3571e,network=Network(55bb0e36-ec83-4f9e-937c-d179bdfd3428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e526ad-60')
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkywjzHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0408061-6cfb-421a-afb4-cabbba9f2da3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:12:53 user nova-compute[75255]: No targets found.
Nov 14 11:12:53 user nova-compute[75255]: iSNS:
Nov 14 11:12:53 user nova-compute[75255]: No targets found.
Nov 14 11:12:53 user nova-compute[75255]: STATIC:
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: FIRMWARE:
Nov 14 11:12:53 user nova-compute[75255]: No targets found.
Nov 14 11:12:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:12:53 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:12:53 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4431bec-b392-456d-9a12-8223b73c2192]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bde74a9-c107-4b40-84f5-4c391c4fd6e8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:53 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30866bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685'): ({'sdd'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Removing single pathed devices sdd {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0dbc8c-684c-417a-a8d7-75f2f43ad9f6]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-b809feb7-2144-4123-8de8-43451d6ec258 for instance with vm_state active and task_state deleting.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-unplugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-5578eb30-f8cc-4113-943f-ec533b734589 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING nova.compute.manager [req-bce74d1e-8259-48da-9a8e-a8b7bcd82d8b req-b0d4dda4-a846-4189-97d8-d865af07c1cf service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-5578eb30-f8cc-4113-943f-ec533b734589 for instance with vm_state active and task_state deleting.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[077cc06d-34bb-4a8c-a666-8b8439b0b7e2]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Flushing IO for device /dev/sdd {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953ac5d-7b04-4c61-b97b-de56ce87f49e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defcd50-68a6-4d33-b36e-6078778e78d4]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08c53e-3aea-4824-9233-6e2c70568d2e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c91c312-3b70-43ce-9221-a047b3fab3aa]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260]
Nov 14 11:12:53 user nova-compute[75255]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685, portal: 172.16.0.220,3260] successful.
Nov 14 11:12:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-ab2e7ac9-e023-4327-9b99-e33b65e1ffed for instance with vm_state active and task_state deleting.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-unplugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 for instance with vm_state active and task_state deleting.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-unplugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-9e99fa23-783f-4c65-8a2b-4e62f2636047 for instance with vm_state active and task_state deleting.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-unplugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-unplugged-51e526ad-60cb-4071-bc74-a01406b3571e for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING nova.compute.manager [req-90f6df67-1e11-4786-aa12-911e1dca2f89 req-ece5bc90-ea6b-4c49-9147-d5fd4ad8e480 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-51e526ad-60cb-4071-bc74-a01406b3571e for instance with vm_state active and task_state deleting.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dd638b1-00a5-439f-9bbf-e68edde8f685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9b0bb-2b16-4106-900d-6c80476d5955]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== disconnect_volume: return (339ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOFzsKmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-d8b50446-0543-4adc-a7b3-e2307c0dd015 req-5aeb0e41-9979-48d8-9e53-0e1e4a8063ba service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d8b50446-0543-4adc-a7b3-e2307c0dd015 req-5aeb0e41-9979-48d8-9e53-0e1e4a8063ba service nova] Acquiring lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d8b50446-0543-4adc-a7b3-e2307c0dd015 req-5aeb0e41-9979-48d8-9e53-0e1e4a8063ba service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d8b50446-0543-4adc-a7b3-e2307c0dd015 req-5aeb0e41-9979-48d8-9e53-0e1e4a8063ba service nova] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-d8b50446-0543-4adc-a7b3-e2307c0dd015 req-5aeb0e41-9979-48d8-9e53-0e1e4a8063ba service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] No waiting events found dispatching network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:12:53 user nova-compute[75255]: WARNING nova.compute.manager [req-d8b50446-0543-4adc-a7b3-e2307c0dd015 req-5aeb0e41-9979-48d8-9e53-0e1e4a8063ba service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received unexpected event network-vif-plugged-5ad47315-5fa1-4867-bb4b-087b246d1751 for instance with vm_state active and task_state deleting.
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38752e61-11d0-4de5-8bef-954d2cd7b5e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:12:53 user nova-compute[75255]: No targets found.
Nov 14 11:12:53 user nova-compute[75255]: iSNS:
Nov 14 11:12:53 user nova-compute[75255]: No targets found.
Nov 14 11:12:53 user nova-compute[75255]: STATIC:
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:12:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:53 user nova-compute[75255]: FIRMWARE:
Nov 14 11:12:53 user nova-compute[75255]: No targets found.
Nov 14 11:12:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:12:54 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:12:54 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c267f49-7faf-4db1-b656-366f1902599d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3212f7a1-1802-4430-8474-4c0c03063589]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff328472440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f'): ({'sdf'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Removing single pathed devices sdf {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f849b976-6364-4985-8cb7-9a029e309abd]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d938ef9-6a5a-47f3-b094-5de51bf899fa]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Flushing IO for device /dev/sdf {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ccfe13-d8b7-4100-980d-01d93fa3e541]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80790c5-312c-4062-b004-77ea720d485d]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5cf828-111e-4a43-9e5c-22ee72795b60]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dec6d0-0de2-4d8a-94d3-3a2675349df9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260]
Nov 14 11:12:54 user nova-compute[75255]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f, portal: 172.16.0.220,3260] successful.
Nov 14 11:12:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef5f1a2-69b6-4ecf-8045-3ea3fd75318f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1daca-54ae-4bf1-94bc-b9c45b394d86]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== disconnect_volume: return (287ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrRNkIlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:12:54 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0831805e-2a79-4404-a77e-647d96df2771]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:12:54 user nova-compute[75255]: No targets found.
Nov 14 11:12:54 user nova-compute[75255]: iSNS:
Nov 14 11:12:54 user nova-compute[75255]: No targets found.
Nov 14 11:12:54 user nova-compute[75255]: STATIC:
Nov 14 11:12:54 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:12:54 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:54 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:54 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649
Nov 14 11:12:54 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:54 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:54 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:12:54 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:12:54 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:12:54 user nova-compute[75255]: FIRMWARE:
Nov 14 11:12:54 user nova-compute[75255]: No targets found.
Nov 14 11:12:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:12:54 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:12:54 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0b966a-f319-48a2-82fc-50503ec25ffd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e7ff3-7b13-48a7-b8c4-9ffd5815c21c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:12:54 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:12:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30866a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649'): ({'sdg'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Removing single pathed devices sdg {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b694dbd-e845-4546-ae60-d207bae4491e]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d60261-3570-44b7-bbdb-e184c1e9b8bb]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Flushing IO for device /dev/sdg {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f1c38-6eae-4109-987b-64c28b10bb82]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb147f-c30f-4d7e-9002-7ba92933e9df]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] SCSI volumes sdg have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[43431fd6-ef42-45a9-b85e-93450bc4fd64]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b9ceab-3366-4fa4-8969-d65d9608ffdc]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260]
Nov 14 11:12:54 user nova-compute[75255]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649, portal: 172.16.0.220,3260] successful.
Nov 14 11:12:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d6843d-811f-480d-8879-b58a37b22649 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[662027c3-769f-4502-9ff1-f816f1f784fc]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] <== disconnect_volume: return (279ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:12:54 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Deleting instance files /opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54_del
Nov 14 11:12:54 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Deletion of /opt/stack/data/nova/instances/1b608f6b-e6ae-4530-8f05-05871ebace54_del complete
Nov 14 11:12:54 user nova-compute[75255]: INFO nova.compute.manager [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Took 3.16 seconds to destroy the instance on the hypervisor.
Nov 14 11:12:54 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:12:54 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:12:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-0cc2bce7-c04f-4689-ab68-78074abedd52 req-b9becd9a-8bb9-4086-a747-9d6a49fdc143 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-deleted-b809feb7-2144-4123-8de8-43451d6ec258 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:56 user nova-compute[75255]: INFO nova.compute.manager [req-0cc2bce7-c04f-4689-ab68-78074abedd52 req-b9becd9a-8bb9-4086-a747-9d6a49fdc143 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Neutron deleted interface b809feb7-2144-4123-8de8-43451d6ec258; detaching it from the instance and deleting it from the info cache
Nov 14 11:12:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-0cc2bce7-c04f-4689-ab68-78074abedd52 req-b9becd9a-8bb9-4086-a747-9d6a49fdc143 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [{"id": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "address": "fa:16:3e:76:df:ed", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab2e7ac9-e0", "ovs_interfaceid": "ab2e7ac9-e023-4327-9b99-e33b65e1ffed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ad47315-5fa1-4867-bb4b-087b246d1751", "address": "fa:16:3e:de:80:e0", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad47315-5f", "ovs_interfaceid": "5ad47315-5fa1-4867-bb4b-087b246d1751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "address": "fa:16:3e:59:52:c1", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed2cf92-6f", "ovs_interfaceid": "4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5578eb30-f8cc-4113-943f-ec533b734589", "address": "fa:16:3e:8c:bf:69", "network": {"id": "8350a163-1d44-4772-b9b7-32d581e17afe", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869021889", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5578eb30-f8", "ovs_interfaceid": "5578eb30-f8cc-4113-943f-ec533b734589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "address": "fa:16:3e:66:03:8c", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e99fa23-78", "ovs_interfaceid": "9e99fa23-783f-4c65-8a2b-4e62f2636047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e526ad-60cb-4071-bc74-a01406b3571e", "address": "fa:16:3e:a3:9a:1d", "network": {"id": "55bb0e36-ec83-4f9e-937c-d179bdfd3428", "bridge": "br-int", "label": "tempest-device-tagging-net2-2130309416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0ae70ce6a6c46a5a7558971f96ddf5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e526ad-60", "ovs_interfaceid": "51e526ad-60cb-4071-bc74-a01406b3571e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-0cc2bce7-c04f-4689-ab68-78074abedd52 req-b9becd9a-8bb9-4086-a747-9d6a49fdc143 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Detach interface failed, port_id=b809feb7-2144-4123-8de8-43451d6ec258, reason: Instance 1b608f6b-e6ae-4530-8f05-05871ebace54 could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:12:58 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:12:58 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Took 3.45 seconds to deallocate network for instance.
Nov 14 11:12:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-52aa43e0-0928-430d-84e3-fdcc723b3d77 req-332b97bd-4c78-4fb6-a32d-c5f455f348a1 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-deleted-4ed2cf92-6fdf-4cba-b079-58c5c3f3dfd3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-52aa43e0-0928-430d-84e3-fdcc723b3d77 req-332b97bd-4c78-4fb6-a32d-c5f455f348a1 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-deleted-5578eb30-f8cc-4113-943f-ec533b734589 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-52aa43e0-0928-430d-84e3-fdcc723b3d77 req-332b97bd-4c78-4fb6-a32d-c5f455f348a1 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-deleted-9e99fa23-783f-4c65-8a2b-4e62f2636047 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-52aa43e0-0928-430d-84e3-fdcc723b3d77 req-332b97bd-4c78-4fb6-a32d-c5f455f348a1 service nova] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Received event network-vif-deleted-51e526ad-60cb-4071-bc74-a01406b3571e {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:12:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:12:59 user nova-compute[75255]: INFO nova.compute.manager [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Unrescuing
Nov 14 11:12:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:12:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:12:59 user nova-compute[75255]: DEBUG nova.network.neutron [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG nova.network.neutron [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG nova.objects.instance [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'flavor' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:00 user nova-compute[75255]: INFO nova.compute.manager [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] [instance: 1b608f6b-e6ae-4530-8f05-05871ebace54] Took 2.31 seconds to detach 3 volumes for instance.
Nov 14 11:13:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-a0e922ca-2f7f-42d2-a26b-a34e01011762 req-37daa91b-a0ba-44d6-b34d-72f471d2227a service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a0e922ca-2f7f-42d2-a26b-a34e01011762 req-37daa91b-a0ba-44d6-b34d-72f471d2227a service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a0e922ca-2f7f-42d2-a26b-a34e01011762 req-37daa91b-a0ba-44d6-b34d-72f471d2227a service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a0e922ca-2f7f-42d2-a26b-a34e01011762 req-37daa91b-a0ba-44d6-b34d-72f471d2227a service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-a0e922ca-2f7f-42d2-a26b-a34e01011762 req-37daa91b-a0ba-44d6-b34d-72f471d2227a service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:00 user nova-compute[75255]: WARNING nova.compute.manager [req-a0e922ca-2f7f-42d2-a26b-a34e01011762 req-37daa91b-a0ba-44d6-b34d-72f471d2227a service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:00 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Deleted allocations for instance 1b608f6b-e6ae-4530-8f05-05871ebace54
Nov 14 11:13:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance destroyed successfully.
Nov 14 11:13:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a86e595a-3ba0-4492-a10c-e02909b18d45 tempest-TaggedBootDevicesTest_v242-1557158929 tempest-TaggedBootDevicesTest_v242-1557158929-project-member] Lock "1b608f6b-e6ae-4530-8f05-05871ebace54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.388s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:02 user nova-compute[75255]: WARNING nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:13:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:02 user nova-compute[75255]: WARNING nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:13:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:02 user nova-compute[75255]: WARNING nova.compute.manager [req-1186d51a-f977-4073-829a-0b58a502c454 req-03203acc-19d3-4822-9ae2-29879db46200 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:13:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-37061db9-e9d2-461f-9913-84d4e6540b46 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:13:05 user nova-compute[75255]: INFO nova.compute.claims [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Claim successful on node user
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:13:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.policy [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501c5fe846ca4bfeacc413c97911f8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524a841af9524bd98f64657594598808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:13:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Creating image(s)
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk 1073741824" returned: 0 in 0.052s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Successfully created port: a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.232s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Cannot resize image /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Ensure instance console log exists: /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Successfully updated port: a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquired lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-changed-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Refreshing instance network info cache due to event network-changed-a2fae558-9762-487f-8242-60321fa137ec. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] Acquiring lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Updating instance_info_cache with network_info: [{"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Releasing lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Instance network_info: |[{"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] Acquired lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Refreshing network info cache for port a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Start _get_guest_xml network_info=[{"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:13:07 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:07 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1328729552',display_name='tempest-AttachVolumeNegativeTest-server-1328729552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1328729552',id=19,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnYGqPsPbTsyZmE5Wv8rUDCxOh9pEZcO89jrf2XrDqY0QUULvb+rG4tlRWroYlBLWTlbW7VwE+UB9Z2NCaycwZBifx22iWY0SHxLzFuAw7aj+wSNyCU4TwXqE3h8iqKNA==',key_name='tempest-keypair-593539062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-2yuhvjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=cfadd2f1-c323-450c-983d-1af5126fe645,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=a2fae558-9762-487f-8242-60321fa137ec,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fae558-97') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.objects.instance [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'pci_devices' on Instance uuid cfadd2f1-c323-450c-983d-1af5126fe645 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:13:07 user nova-compute[75255]:   <uuid>cfadd2f1-c323-450c-983d-1af5126fe645</uuid>
Nov 14 11:13:07 user nova-compute[75255]:   <name>instance-00000013</name>
Nov 14 11:13:07 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:13:07 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:13:07 user nova-compute[75255]:   <metadata>
Nov 14 11:13:07 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:13:07 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:13:07 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1328729552</nova:name>
Nov 14 11:13:07 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:13:07</nova:creationTime>
Nov 14 11:13:07 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:13:07 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:13:07 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:13:07 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:13:07 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:13:07 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:13:07 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:13:07 user nova-compute[75255]:       <nova:owner>
Nov 14 11:13:07 user nova-compute[75255]:         <nova:user uuid="501c5fe846ca4bfeacc413c97911f8f6">tempest-AttachVolumeNegativeTest-1930109654-project-member</nova:user>
Nov 14 11:13:07 user nova-compute[75255]:         <nova:project uuid="524a841af9524bd98f64657594598808">tempest-AttachVolumeNegativeTest-1930109654</nova:project>
Nov 14 11:13:07 user nova-compute[75255]:       </nova:owner>
Nov 14 11:13:07 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:13:07 user nova-compute[75255]:       <nova:ports>
Nov 14 11:13:07 user nova-compute[75255]:         <nova:port uuid="a2fae558-9762-487f-8242-60321fa137ec">
Nov 14 11:13:07 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 11:13:07 user nova-compute[75255]:         </nova:port>
Nov 14 11:13:07 user nova-compute[75255]:       </nova:ports>
Nov 14 11:13:07 user nova-compute[75255]:     </nova:instance>
Nov 14 11:13:07 user nova-compute[75255]:   </metadata>
Nov 14 11:13:07 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:13:07 user nova-compute[75255]:     <system>
Nov 14 11:13:07 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:13:07 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:13:07 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:13:07 user nova-compute[75255]:       <entry name="serial">cfadd2f1-c323-450c-983d-1af5126fe645</entry>
Nov 14 11:13:07 user nova-compute[75255]:       <entry name="uuid">cfadd2f1-c323-450c-983d-1af5126fe645</entry>
Nov 14 11:13:07 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:13:07 user nova-compute[75255]:     </system>
Nov 14 11:13:07 user nova-compute[75255]:   </sysinfo>
Nov 14 11:13:07 user nova-compute[75255]:   <os>
Nov 14 11:13:07 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:13:07 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:13:07 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:13:07 user nova-compute[75255]:   </os>
Nov 14 11:13:07 user nova-compute[75255]:   <features>
Nov 14 11:13:07 user nova-compute[75255]:     <acpi/>
Nov 14 11:13:07 user nova-compute[75255]:     <apic/>
Nov 14 11:13:07 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:13:07 user nova-compute[75255]:   </features>
Nov 14 11:13:07 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:13:07 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:13:07 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:13:07 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:13:07 user nova-compute[75255]:   </clock>
Nov 14 11:13:07 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:13:07 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:13:07 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:13:07 user nova-compute[75255]:   </cpu>
Nov 14 11:13:07 user nova-compute[75255]:   <devices>
Nov 14 11:13:07 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:13:07 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:13:07 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk"/>
Nov 14 11:13:07 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:13:07 user nova-compute[75255]:     </disk>
Nov 14 11:13:07 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:13:07 user nova-compute[75255]:       <mac address="fa:16:3e:2f:a7:5d"/>
Nov 14 11:13:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:13:07 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:13:07 user nova-compute[75255]:       <target dev="tapa2fae558-97"/>
Nov 14 11:13:07 user nova-compute[75255]:     </interface>
Nov 14 11:13:07 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:13:07 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/console.log" append="off"/>
Nov 14 11:13:07 user nova-compute[75255]:     </serial>
Nov 14 11:13:07 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:13:07 user nova-compute[75255]:     <video>
Nov 14 11:13:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:13:07 user nova-compute[75255]:     </video>
Nov 14 11:13:07 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:13:07 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:13:07 user nova-compute[75255]:     </rng>
Nov 14 11:13:07 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:13:07 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:13:07 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:13:07 user nova-compute[75255]:     </memballoon>
Nov 14 11:13:07 user nova-compute[75255]:   </devices>
Nov 14 11:13:07 user nova-compute[75255]: </domain>
Nov 14 11:13:07 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1328729552',display_name='tempest-AttachVolumeNegativeTest-server-1328729552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1328729552',id=19,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnYGqPsPbTsyZmE5Wv8rUDCxOh9pEZcO89jrf2XrDqY0QUULvb+rG4tlRWroYlBLWTlbW7VwE+UB9Z2NCaycwZBifx22iWY0SHxLzFuAw7aj+wSNyCU4TwXqE3h8iqKNA==',key_name='tempest-keypair-593539062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-2yuhvjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=cfadd2f1-c323-450c-983d-1af5126fe645,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=a2fae558-9762-487f-8242-60321fa137ec,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fae558-97') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG os_vif [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=a2fae558-9762-487f-8242-60321fa137ec,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fae558-97') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a3fa5ca-624a-57c0-a0c4-40c772dd8434', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2fae558-97, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2fae558-97, col_values=(('qos', UUID('2b2d82ed-23d0-4491-8aea-17825a495c92')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2fae558-97, col_values=(('external_ids', {'iface-id': 'a2fae558-9762-487f-8242-60321fa137ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:a7:5d', 'vm-uuid': 'cfadd2f1-c323-450c-983d-1af5126fe645'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:07 user nova-compute[75255]: INFO os_vif [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=a2fae558-9762-487f-8242-60321fa137ec,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fae558-97')
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:13:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No VIF found with MAC fa:16:3e:2f:a7:5d, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:13:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Updated VIF entry in instance network info cache for port a2fae558-9762-487f-8242-60321fa137ec. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:13:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Updating instance_info_cache with network_info: [{"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a8a07014-4161-4ff0-be28-709534d97713 req-1990c470-3f6f-48e9-b801-f8d5c6098b7d service nova] Releasing lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-26205781-2628-490b-8b68-0eb40811b2e4 req-6ecda5b6-ea31-43e7-ba8e-008f704cf90b service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-26205781-2628-490b-8b68-0eb40811b2e4 req-6ecda5b6-ea31-43e7-ba8e-008f704cf90b service nova] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-26205781-2628-490b-8b68-0eb40811b2e4 req-6ecda5b6-ea31-43e7-ba8e-008f704cf90b service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-26205781-2628-490b-8b68-0eb40811b2e4 req-6ecda5b6-ea31-43e7-ba8e-008f704cf90b service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-26205781-2628-490b-8b68-0eb40811b2e4 req-6ecda5b6-ea31-43e7-ba8e-008f704cf90b service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] No waiting events found dispatching network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:09 user nova-compute[75255]: WARNING nova.compute.manager [req-26205781-2628-490b-8b68-0eb40811b2e4 req-6ecda5b6-ea31-43e7-ba8e-008f704cf90b service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received unexpected event network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec for instance with vm_state building and task_state spawning.
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:13:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Instance spawned successfully.
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-f452a74a-472c-4c96-80dc-43d3f48aee3a req-e86c8150-62d5-4a34-a1cf-f295ecff57f7 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f452a74a-472c-4c96-80dc-43d3f48aee3a req-e86c8150-62d5-4a34-a1cf-f295ecff57f7 service nova] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f452a74a-472c-4c96-80dc-43d3f48aee3a req-e86c8150-62d5-4a34-a1cf-f295ecff57f7 service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f452a74a-472c-4c96-80dc-43d3f48aee3a req-e86c8150-62d5-4a34-a1cf-f295ecff57f7 service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-f452a74a-472c-4c96-80dc-43d3f48aee3a req-e86c8150-62d5-4a34-a1cf-f295ecff57f7 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] No waiting events found dispatching network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:11 user nova-compute[75255]: WARNING nova.compute.manager [req-f452a74a-472c-4c96-80dc-43d3f48aee3a req-e86c8150-62d5-4a34-a1cf-f295ecff57f7 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received unexpected event network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec for instance with vm_state building and task_state spawning.
Nov 14 11:13:11 user nova-compute[75255]: INFO nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 14 11:13:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:13:11 user nova-compute[75255]: INFO nova.compute.manager [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Took 6.15 seconds to build instance.
Nov 14 11:13:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-053f355d-14f1-48f1-8d7c-50959467caea tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.277s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:13:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:13:16 user nova-compute[75255]: INFO nova.compute.claims [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Claim successful on node user
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:13:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.policy [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b20309458694432394da4ee00f67638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39b62cd90bd47778d70766751118de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:13:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Creating image(s)
Nov 14 11:13:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "/opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "/opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "/opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "51b5fd386b1cc6c662a5226dfd9b429ec386bbaf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "51b5fd386b1cc6c662a5226dfd9b429ec386bbaf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Successfully created port: 01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.virt.images [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] 27563495-7709-4f47-b9c9-d88dd1bf7c26 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.part /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.part /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.converted" returned: 0 in 0.149s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "51b5fd386b1cc6c662a5226dfd9b429ec386bbaf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.099s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Successfully updated port: 01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf --force-share --output=json" returned: 0 in 0.228s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "51b5fd386b1cc6c662a5226dfd9b429ec386bbaf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "51b5fd386b1cc6c662a5226dfd9b429ec386bbaf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing instance network info cache due to event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf --force-share --output=json" returned: 0 in 0.195s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf,backing_fmt=raw /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf,backing_fmt=raw /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk 1073741824" returned: 0 in 0.047s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "51b5fd386b1cc6c662a5226dfd9b429ec386bbaf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Cannot resize image /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Ensure instance console log exists: /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance network_info: |[{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Start _get_guest_xml network_info=[{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:13:13Z,direct_url=<?>,disk_format='qcow2',id=27563495-7709-4f47-b9c9-d88dd1bf7c26,min_disk=0,min_ram=0,name='tempest-scenario-img--1931320935',owner='e39b62cd90bd47778d70766751118de4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:13:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '27563495-7709-4f47-b9c9-d88dd1bf7c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:13:19 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:19 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:13:13Z,direct_url=<?>,disk_format='qcow2',id=27563495-7709-4f47-b9c9-d88dd1bf7c26,min_disk=0,min_ram=0,name='tempest-scenario-img--1931320935',owner='e39b62cd90bd47778d70766751118de4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:13:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-565416391',display_name='tempest-TestMinimumBasicScenario-server-565416391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-565416391',id=20,image_ref='27563495-7709-4f47-b9c9-d88dd1bf7c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXNbwGD906zGqD1yaGV94lEM+IqX5JwRyNE90DTvqJNT00ayr3FwRmEcQ9YWutZ/7lpDYO4fRmckpQAMtGPKKFTEK3Jcm+KKVaBxyPRoSBNXkQSbNVs1IcjhwurfUn+7g==',key_name='tempest-TestMinimumBasicScenario-1375661165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-02eqj898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27563495-7709-4f47-b9c9-d88dd1bf7c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:13:17Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=c27772f3-df22-4b0b-bb50-8fdf8de7c846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f0:0c,bridge_name='br-int',has_traffic_filtering=True,id=01fbf551-a2f6-4910-9b9a-c27a216c78c9,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fbf551-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'pci_devices' on Instance uuid c27772f3-df22-4b0b-bb50-8fdf8de7c846 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:13:19 user nova-compute[75255]:   <uuid>c27772f3-df22-4b0b-bb50-8fdf8de7c846</uuid>
Nov 14 11:13:19 user nova-compute[75255]:   <name>instance-00000014</name>
Nov 14 11:13:19 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:13:19 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:13:19 user nova-compute[75255]:   <metadata>
Nov 14 11:13:19 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:13:19 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:13:19 user nova-compute[75255]:       <nova:name>tempest-TestMinimumBasicScenario-server-565416391</nova:name>
Nov 14 11:13:19 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:13:19</nova:creationTime>
Nov 14 11:13:19 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:13:19 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:13:19 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:13:19 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:13:19 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:13:19 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:13:19 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:13:19 user nova-compute[75255]:       <nova:owner>
Nov 14 11:13:19 user nova-compute[75255]:         <nova:user uuid="b20309458694432394da4ee00f67638b">tempest-TestMinimumBasicScenario-1092480951-project-member</nova:user>
Nov 14 11:13:19 user nova-compute[75255]:         <nova:project uuid="e39b62cd90bd47778d70766751118de4">tempest-TestMinimumBasicScenario-1092480951</nova:project>
Nov 14 11:13:19 user nova-compute[75255]:       </nova:owner>
Nov 14 11:13:19 user nova-compute[75255]:       <nova:root type="image" uuid="27563495-7709-4f47-b9c9-d88dd1bf7c26"/>
Nov 14 11:13:19 user nova-compute[75255]:       <nova:ports>
Nov 14 11:13:19 user nova-compute[75255]:         <nova:port uuid="01fbf551-a2f6-4910-9b9a-c27a216c78c9">
Nov 14 11:13:19 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:13:19 user nova-compute[75255]:         </nova:port>
Nov 14 11:13:19 user nova-compute[75255]:       </nova:ports>
Nov 14 11:13:19 user nova-compute[75255]:     </nova:instance>
Nov 14 11:13:19 user nova-compute[75255]:   </metadata>
Nov 14 11:13:19 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:13:19 user nova-compute[75255]:     <system>
Nov 14 11:13:19 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:13:19 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:13:19 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:13:19 user nova-compute[75255]:       <entry name="serial">c27772f3-df22-4b0b-bb50-8fdf8de7c846</entry>
Nov 14 11:13:19 user nova-compute[75255]:       <entry name="uuid">c27772f3-df22-4b0b-bb50-8fdf8de7c846</entry>
Nov 14 11:13:19 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:13:19 user nova-compute[75255]:     </system>
Nov 14 11:13:19 user nova-compute[75255]:   </sysinfo>
Nov 14 11:13:19 user nova-compute[75255]:   <os>
Nov 14 11:13:19 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:13:19 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:13:19 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:13:19 user nova-compute[75255]:   </os>
Nov 14 11:13:19 user nova-compute[75255]:   <features>
Nov 14 11:13:19 user nova-compute[75255]:     <acpi/>
Nov 14 11:13:19 user nova-compute[75255]:     <apic/>
Nov 14 11:13:19 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:13:19 user nova-compute[75255]:   </features>
Nov 14 11:13:19 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:13:19 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:13:19 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:13:19 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:13:19 user nova-compute[75255]:   </clock>
Nov 14 11:13:19 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:13:19 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:13:19 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:13:19 user nova-compute[75255]:   </cpu>
Nov 14 11:13:19 user nova-compute[75255]:   <devices>
Nov 14 11:13:19 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:13:19 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:13:19 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk"/>
Nov 14 11:13:19 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:13:19 user nova-compute[75255]:     </disk>
Nov 14 11:13:19 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:13:19 user nova-compute[75255]:       <mac address="fa:16:3e:07:f0:0c"/>
Nov 14 11:13:19 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:13:19 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:13:19 user nova-compute[75255]:       <target dev="tap01fbf551-a2"/>
Nov 14 11:13:19 user nova-compute[75255]:     </interface>
Nov 14 11:13:19 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:13:19 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/console.log" append="off"/>
Nov 14 11:13:19 user nova-compute[75255]:     </serial>
Nov 14 11:13:19 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:13:19 user nova-compute[75255]:     <video>
Nov 14 11:13:19 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:13:19 user nova-compute[75255]:     </video>
Nov 14 11:13:19 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:13:19 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:13:19 user nova-compute[75255]:     </rng>
Nov 14 11:13:19 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:13:19 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:13:19 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:13:19 user nova-compute[75255]:     </memballoon>
Nov 14 11:13:19 user nova-compute[75255]:   </devices>
Nov 14 11:13:19 user nova-compute[75255]: </domain>
Nov 14 11:13:19 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-565416391',display_name='tempest-TestMinimumBasicScenario-server-565416391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-565416391',id=20,image_ref='27563495-7709-4f47-b9c9-d88dd1bf7c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXNbwGD906zGqD1yaGV94lEM+IqX5JwRyNE90DTvqJNT00ayr3FwRmEcQ9YWutZ/7lpDYO4fRmckpQAMtGPKKFTEK3Jcm+KKVaBxyPRoSBNXkQSbNVs1IcjhwurfUn+7g==',key_name='tempest-TestMinimumBasicScenario-1375661165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-02eqj898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27563495-7709-4f47-b9c9-d88dd1bf7c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:13:17Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=c27772f3-df22-4b0b-bb50-8fdf8de7c846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f0:0c,bridge_name='br-int',has_traffic_filtering=True,id=01fbf551-a2f6-4910-9b9a-c27a216c78c9,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fbf551-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG os_vif [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f0:0c,bridge_name='br-int',has_traffic_filtering=True,id=01fbf551-a2f6-4910-9b9a-c27a216c78c9,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fbf551-a2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30b57828-8766-5a3b-b1b3-92135f020489', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01fbf551-a2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01fbf551-a2, col_values=(('qos', UUID('27d854fa-80d1-4ed2-9a89-b1c59a83f96c')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01fbf551-a2, col_values=(('external_ids', {'iface-id': '01fbf551-a2f6-4910-9b9a-c27a216c78c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:f0:0c', 'vm-uuid': 'c27772f3-df22-4b0b-bb50-8fdf8de7c846'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:19 user nova-compute[75255]: INFO os_vif [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f0:0c,bridge_name='br-int',has_traffic_filtering=True,id=01fbf551-a2f6-4910-9b9a-c27a216c78c9,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fbf551-a2')
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No VIF found with MAC fa:16:3e:07:f0:0c, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updated VIF entry in instance network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4f83c798-609a-47d4-ab6f-8cf3e0242c9a req-0778d7f7-8278-45ea-b0ff-ffb4c3ba7062 service nova] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-71727dd3-d52c-472c-b0b3-129e7aabcfba req-e2b20766-20ac-4a6e-9564-48bc7285c8a8 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-71727dd3-d52c-472c-b0b3-129e7aabcfba req-e2b20766-20ac-4a6e-9564-48bc7285c8a8 service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-71727dd3-d52c-472c-b0b3-129e7aabcfba req-e2b20766-20ac-4a6e-9564-48bc7285c8a8 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-71727dd3-d52c-472c-b0b3-129e7aabcfba req-e2b20766-20ac-4a6e-9564-48bc7285c8a8 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-71727dd3-d52c-472c-b0b3-129e7aabcfba req-e2b20766-20ac-4a6e-9564-48bc7285c8a8 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:21 user nova-compute[75255]: WARNING nova.compute.manager [req-71727dd3-d52c-472c-b0b3-129e7aabcfba req-e2b20766-20ac-4a6e-9564-48bc7285c8a8 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received unexpected event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with vm_state building and task_state spawning.
Nov 14 11:13:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:13:21 user nova-compute[75255]: INFO nova.compute.manager [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] instance snapshotting
Nov 14 11:13:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Beginning live snapshot process
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.269s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.251s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp_zlz457/bfb7ae355c9d477b93fbb5ffea8c9191.delta 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp_zlz457/bfb7ae355c9d477b93fbb5ffea8c9191.delta 1073741824" returned: 0 in 0.061s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-0297d121-e42b-4fb3-81cf-f1723a7d2083 req-44d75d66-48dc-47b1-8806-c7a13040e04d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0297d121-e42b-4fb3-81cf-f1723a7d2083 req-44d75d66-48dc-47b1-8806-c7a13040e04d service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0297d121-e42b-4fb3-81cf-f1723a7d2083 req-44d75d66-48dc-47b1-8806-c7a13040e04d service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0297d121-e42b-4fb3-81cf-f1723a7d2083 req-44d75d66-48dc-47b1-8806-c7a13040e04d service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-0297d121-e42b-4fb3-81cf-f1723a7d2083 req-44d75d66-48dc-47b1-8806-c7a13040e04d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:23 user nova-compute[75255]: WARNING nova.compute.manager [req-0297d121-e42b-4fb3-81cf-f1723a7d2083 req-44d75d66-48dc-47b1-8806-c7a13040e04d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received unexpected event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with vm_state building and task_state spawning.
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:13:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance spawned successfully.
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:23 user nova-compute[75255]: INFO nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:13:23 user nova-compute[75255]: INFO nova.compute.manager [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Took 7.07 seconds to build instance.
Nov 14 11:13:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3b6df389-1884-498a-9b51-7157efcef2e0 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.180s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:13:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:13:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 11:13:24 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:13:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp_zlz457/bfb7ae355c9d477b93fbb5ffea8c9191.delta /opt/stack/data/nova/instances/snapshots/tmpp_zlz457/bfb7ae355c9d477b93fbb5ffea8c9191 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp_zlz457/bfb7ae355c9d477b93fbb5ffea8c9191.delta /opt/stack/data/nova/instances/snapshots/tmpp_zlz457/bfb7ae355c9d477b93fbb5ffea8c9191" returned: 0 in 0.910s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Snapshot extracted, beginning image upload
Nov 14 11:13:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-changed-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Refreshing instance network info cache due to event network-changed-7492baa9-355a-4952-b448-c87d075c46d5. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:13:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] Acquiring lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] Acquired lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Refreshing network info cache for port 7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:13:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updated VIF entry in instance network info cache for port 7492baa9-355a-4952-b448-c87d075c46d5. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:13:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d9d5871-94e1-42e4-9e6a-bdd44d3961de req-2a76968b-36c2-4d6e-91fb-1830b28f628d service nova] Releasing lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Snapshot image upload complete
Nov 14 11:13:28 user nova-compute[75255]: INFO nova.compute.manager [None req-e7eba50e-4b5f-410b-9e74-d2bb03cab451 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Took 6.97 seconds to snapshot the instance on the hypervisor.
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:13:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:32 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:32 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7900MB free_disk=25.336551666259766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 63b41a9a-238d-49a9-869b-04f93807a162 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance cfadd2f1-c323-450c-983d-1af5126fe645 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:13:32 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:13:33 user nova-compute[75255]: INFO nova.compute.claims [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Claim successful on node user
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:13:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:13:33 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.policy [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4912cae05e5648bfbee95a1b0db00c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c4a2ca3bf344d8a0ea69c79c51fce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:13:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Creating image(s)
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "/opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "/opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "/opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk 1073741824" returned: 0 in 0.046s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Successfully created port: 9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Cannot resize image /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Ensure instance console log exists: /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Successfully updated port: 9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "refresh_cache-c965a0f1-c9f3-403e-904d-4c3daf764d1f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquired lock "refresh_cache-c965a0f1-c9f3-403e-904d-4c3daf764d1f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received event network-changed-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Refreshing instance network info cache due to event network-changed-9e48dea4-df18-4c77-b834-fb779d0da13c. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] Acquiring lock "refresh_cache-c965a0f1-c9f3-403e-904d-4c3daf764d1f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Updating instance_info_cache with network_info: [{"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Releasing lock "refresh_cache-c965a0f1-c9f3-403e-904d-4c3daf764d1f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Instance network_info: |[{"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] Acquired lock "refresh_cache-c965a0f1-c9f3-403e-904d-4c3daf764d1f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.neutron [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Refreshing network info cache for port 9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Start _get_guest_xml network_info=[{"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:13:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-643314655',display_name='tempest-DeleteServersTestJSON-server-643314655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-643314655',id=21,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21c4a2ca3bf344d8a0ea69c79c51fce0',ramdisk_id='',reservation_id='r-r2sz8qs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1653490136',owner_user_name='tempest-DeleteServersTestJSON-1653490136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:13:34Z,user_data=None,user_id='4912cae05e5648bfbee95a1b0db00c09',uuid=c965a0f1-c9f3-403e-904d-4c3daf764d1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Converting VIF {"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e3:02,bridge_name='br-int',has_traffic_filtering=True,id=9e48dea4-df18-4c77-b834-fb779d0da13c,network=Network(0824b5f3-bebd-4071-b8be-3bdf01ab4619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e48dea4-df') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lazy-loading 'pci_devices' on Instance uuid c965a0f1-c9f3-403e-904d-4c3daf764d1f {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:13:35 user nova-compute[75255]:   <uuid>c965a0f1-c9f3-403e-904d-4c3daf764d1f</uuid>
Nov 14 11:13:35 user nova-compute[75255]:   <name>instance-00000015</name>
Nov 14 11:13:35 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:13:35 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:13:35 user nova-compute[75255]:   <metadata>
Nov 14 11:13:35 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:13:35 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:13:35 user nova-compute[75255]:       <nova:name>tempest-DeleteServersTestJSON-server-643314655</nova:name>
Nov 14 11:13:35 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:13:35</nova:creationTime>
Nov 14 11:13:35 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:13:35 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:13:35 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:13:35 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:13:35 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:13:35 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:13:35 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:13:35 user nova-compute[75255]:       <nova:owner>
Nov 14 11:13:35 user nova-compute[75255]:         <nova:user uuid="4912cae05e5648bfbee95a1b0db00c09">tempest-DeleteServersTestJSON-1653490136-project-member</nova:user>
Nov 14 11:13:35 user nova-compute[75255]:         <nova:project uuid="21c4a2ca3bf344d8a0ea69c79c51fce0">tempest-DeleteServersTestJSON-1653490136</nova:project>
Nov 14 11:13:35 user nova-compute[75255]:       </nova:owner>
Nov 14 11:13:35 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:13:35 user nova-compute[75255]:       <nova:ports>
Nov 14 11:13:35 user nova-compute[75255]:         <nova:port uuid="9e48dea4-df18-4c77-b834-fb779d0da13c">
Nov 14 11:13:35 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 11:13:35 user nova-compute[75255]:         </nova:port>
Nov 14 11:13:35 user nova-compute[75255]:       </nova:ports>
Nov 14 11:13:35 user nova-compute[75255]:     </nova:instance>
Nov 14 11:13:35 user nova-compute[75255]:   </metadata>
Nov 14 11:13:35 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:13:35 user nova-compute[75255]:     <system>
Nov 14 11:13:35 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:13:35 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:13:35 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:13:35 user nova-compute[75255]:       <entry name="serial">c965a0f1-c9f3-403e-904d-4c3daf764d1f</entry>
Nov 14 11:13:35 user nova-compute[75255]:       <entry name="uuid">c965a0f1-c9f3-403e-904d-4c3daf764d1f</entry>
Nov 14 11:13:35 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:13:35 user nova-compute[75255]:     </system>
Nov 14 11:13:35 user nova-compute[75255]:   </sysinfo>
Nov 14 11:13:35 user nova-compute[75255]:   <os>
Nov 14 11:13:35 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:13:35 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:13:35 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:13:35 user nova-compute[75255]:   </os>
Nov 14 11:13:35 user nova-compute[75255]:   <features>
Nov 14 11:13:35 user nova-compute[75255]:     <acpi/>
Nov 14 11:13:35 user nova-compute[75255]:     <apic/>
Nov 14 11:13:35 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:13:35 user nova-compute[75255]:   </features>
Nov 14 11:13:35 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:13:35 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:13:35 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:13:35 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:13:35 user nova-compute[75255]:   </clock>
Nov 14 11:13:35 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:13:35 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:13:35 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:13:35 user nova-compute[75255]:   </cpu>
Nov 14 11:13:35 user nova-compute[75255]:   <devices>
Nov 14 11:13:35 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:13:35 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:13:35 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk"/>
Nov 14 11:13:35 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:13:35 user nova-compute[75255]:     </disk>
Nov 14 11:13:35 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:13:35 user nova-compute[75255]:       <mac address="fa:16:3e:92:e3:02"/>
Nov 14 11:13:35 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:13:35 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:13:35 user nova-compute[75255]:       <target dev="tap9e48dea4-df"/>
Nov 14 11:13:35 user nova-compute[75255]:     </interface>
Nov 14 11:13:35 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:13:35 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/console.log" append="off"/>
Nov 14 11:13:35 user nova-compute[75255]:     </serial>
Nov 14 11:13:35 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:13:35 user nova-compute[75255]:     <video>
Nov 14 11:13:35 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:13:35 user nova-compute[75255]:     </video>
Nov 14 11:13:35 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:13:35 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:13:35 user nova-compute[75255]:     </rng>
Nov 14 11:13:35 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:13:35 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:13:35 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:13:35 user nova-compute[75255]:     </memballoon>
Nov 14 11:13:35 user nova-compute[75255]:   </devices>
Nov 14 11:13:35 user nova-compute[75255]: </domain>
Nov 14 11:13:35 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-643314655',display_name='tempest-DeleteServersTestJSON-server-643314655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-643314655',id=21,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21c4a2ca3bf344d8a0ea69c79c51fce0',ramdisk_id='',reservation_id='r-r2sz8qs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1653490136',owner_user_name='tempest-DeleteServersTestJSON-1653490136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:13:34Z,user_data=None,user_id='4912cae05e5648bfbee95a1b0db00c09',uuid=c965a0f1-c9f3-403e-904d-4c3daf764d1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Converting VIF {"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e3:02,bridge_name='br-int',has_traffic_filtering=True,id=9e48dea4-df18-4c77-b834-fb779d0da13c,network=Network(0824b5f3-bebd-4071-b8be-3bdf01ab4619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e48dea4-df') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG os_vif [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e3:02,bridge_name='br-int',has_traffic_filtering=True,id=9e48dea4-df18-4c77-b834-fb779d0da13c,network=Network(0824b5f3-bebd-4071-b8be-3bdf01ab4619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e48dea4-df') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92fd0078-f756-56fa-9358-0965e07f92a8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e48dea4-df, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e48dea4-df, col_values=(('qos', UUID('da616a16-860f-43c4-8d89-4c579f3b07ec')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e48dea4-df, col_values=(('external_ids', {'iface-id': '9e48dea4-df18-4c77-b834-fb779d0da13c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e3:02', 'vm-uuid': 'c965a0f1-c9f3-403e-904d-4c3daf764d1f'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:13:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:35 user nova-compute[75255]: INFO os_vif [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e3:02,bridge_name='br-int',has_traffic_filtering=True,id=9e48dea4-df18-4c77-b834-fb779d0da13c,network=Network(0824b5f3-bebd-4071-b8be-3bdf01ab4619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e48dea4-df')
Nov 14 11:13:36 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Skipping network cache update for instance because it is Building. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] No VIF found with MAC fa:16:3e:92:e3:02, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.network.neutron [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Updated VIF entry in instance network info cache for port 9e48dea4-df18-4c77-b834-fb779d0da13c. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.network.neutron [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Updating instance_info_cache with network_info: [{"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ca4b6f01-06c1-4256-8ea7-dcf173758d5f req-a5494849-f4af-48ab-9231-9cf94c1a6375 service nova] Releasing lock "refresh_cache-c965a0f1-c9f3-403e-904d-4c3daf764d1f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-5cbbef0c-004b-45f1-8ea5-0d8b9cb69f2f req-e248eec1-4292-4171-a5a0-56d5f4e23404 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received event network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5cbbef0c-004b-45f1-8ea5-0d8b9cb69f2f req-e248eec1-4292-4171-a5a0-56d5f4e23404 service nova] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5cbbef0c-004b-45f1-8ea5-0d8b9cb69f2f req-e248eec1-4292-4171-a5a0-56d5f4e23404 service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5cbbef0c-004b-45f1-8ea5-0d8b9cb69f2f req-e248eec1-4292-4171-a5a0-56d5f4e23404 service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-5cbbef0c-004b-45f1-8ea5-0d8b9cb69f2f req-e248eec1-4292-4171-a5a0-56d5f4e23404 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] No waiting events found dispatching network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:37 user nova-compute[75255]: WARNING nova.compute.manager [req-5cbbef0c-004b-45f1-8ea5-0d8b9cb69f2f req-e248eec1-4292-4171-a5a0-56d5f4e23404 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received unexpected event network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c for instance with vm_state building and task_state spawning.
Nov 14 11:13:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:13:39 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Instance spawned successfully.
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:13:39 user nova-compute[75255]: INFO nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:13:39 user nova-compute[75255]: INFO nova.compute.manager [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Took 6.07 seconds to build instance.
Nov 14 11:13:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e3ef4b-925d-4eb2-8eda-c215959d90e6 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.165s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-82a63c4a-f965-4094-9a8a-69fa2da4cd42 req-3e020972-2bc6-46f2-b01d-230951356652 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received event network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82a63c4a-f965-4094-9a8a-69fa2da4cd42 req-3e020972-2bc6-46f2-b01d-230951356652 service nova] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82a63c4a-f965-4094-9a8a-69fa2da4cd42 req-3e020972-2bc6-46f2-b01d-230951356652 service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82a63c4a-f965-4094-9a8a-69fa2da4cd42 req-3e020972-2bc6-46f2-b01d-230951356652 service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-82a63c4a-f965-4094-9a8a-69fa2da4cd42 req-3e020972-2bc6-46f2-b01d-230951356652 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] No waiting events found dispatching network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:39 user nova-compute[75255]: WARNING nova.compute.manager [req-82a63c4a-f965-4094-9a8a-69fa2da4cd42 req-3e020972-2bc6-46f2-b01d-230951356652 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received unexpected event network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c for instance with vm_state active and task_state None.
Nov 14 11:13:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:42 user nova-compute[75255]: DEBUG nova.compute.manager [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-changed-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:42 user nova-compute[75255]: DEBUG nova.compute.manager [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Refreshing instance network info cache due to event network-changed-237b1bfe-ef57-4580-9fa8-55ead0cf29fd. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:13:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] Acquiring lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:13:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] Acquired lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:13:42 user nova-compute[75255]: DEBUG nova.network.neutron [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Refreshing network info cache for port 237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:13:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updated VIF entry in instance network info cache for port 237b1bfe-ef57-4580-9fa8-55ead0cf29fd. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:13:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updating instance_info_cache with network_info: [{"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:13:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-27e7201e-2320-403d-9b3c-515cbcfe2d6a req-03e5fc0f-fd7a-4b68-b396-4b70f57a588e service nova] Releasing lock "refresh_cache-63b41a9a-238d-49a9-869b-04f93807a162" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:13:43 user nova-compute[75255]: INFO nova.compute.manager [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Rebuilding instance
Nov 14 11:13:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-48aa5598-646c-403e-8042-eb9550f186a1 req-bbd5f68d-0d73-4b35-b4f6-be176809b026 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-unplugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-48aa5598-646c-403e-8042-eb9550f186a1 req-bbd5f68d-0d73-4b35-b4f6-be176809b026 service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-48aa5598-646c-403e-8042-eb9550f186a1 req-bbd5f68d-0d73-4b35-b4f6-be176809b026 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-48aa5598-646c-403e-8042-eb9550f186a1 req-bbd5f68d-0d73-4b35-b4f6-be176809b026 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-48aa5598-646c-403e-8042-eb9550f186a1 req-bbd5f68d-0d73-4b35-b4f6-be176809b026 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No waiting events found dispatching network-vif-unplugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:13:44 user nova-compute[75255]: WARNING nova.compute.manager [req-48aa5598-646c-403e-8042-eb9550f186a1 req-bbd5f68d-0d73-4b35-b4f6-be176809b026 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received unexpected event network-vif-unplugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with vm_state active and task_state rebuilding.
Nov 14 11:13:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance destroyed successfully.
Nov 14 11:13:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance destroyed successfully.
Nov 14 11:13:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-447666239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1499633906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwU1xv1xc32UMmh521HPmm6gpJwDUhaPj4v1hgrYr86Gslhx3Uank+yCUbau5rZTLI7k7xw1cjFV4LqT2I3ukBAwJ5YycfeR1ZKh0NIzC0EPgZh24zBPEC2vcJeI8HzNA==',key_name='tempest-keypair-1814893210',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5897376b7cd49f1bd1023adcb84221d',ramdisk_id='',reservation_id='r-x04jsgts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1203206168',owner_user_name='tempest-ServerActionsV293TestJSON-1203206168-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='382ccde674c04896a70d745cb2da3529',uuid=63b41a9a-238d-49a9-869b-04f93807a162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converting VIF {"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_vif [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap237b1bfe-ef, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dcd2a7c-26b9-4579-b08b-acdcec2777e1) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:13:44 user nova-compute[75255]: INFO os_vif [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef')
Nov 14 11:13:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:13:44 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a3b490-0443-4207-b67e-5e6c7396d0dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:13:44 user nova-compute[75255]: No targets found.
Nov 14 11:13:44 user nova-compute[75255]: iSNS:
Nov 14 11:13:44 user nova-compute[75255]: No targets found.
Nov 14 11:13:44 user nova-compute[75255]: STATIC:
Nov 14 11:13:44 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:13:44 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:13:44 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:13:44 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:13:44 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:13:44 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:13:44 user nova-compute[75255]: FIRMWARE:
Nov 14 11:13:44 user nova-compute[75255]: No targets found.
Nov 14 11:13:44 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:13:44 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:13:44 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[544f9d87-81bc-4246-8349-50af1ef2b067]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01902ca-da95-41d7-b1f9-5860dd31db7f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:13:44 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:13:44 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:13:44 user nova-compute[75255]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:13:44 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff338412950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55db89-e58e-438e-82bf-4642ece2d37a]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e570381-e795-4227-acc0-c524529c0619]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37cfa9c-95bd-48f1-a0ac-c46e8cc2ad91]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:13:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d33974-02fe-4c98-b3d5-78631f8c24d2]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_93f18296', '/dev/disk/by-id/scsi-1SCST_BIO93f18296-4a9dcdf3bbed0ec9', '/dev/disk/by-id/scsi-23461396463646633') {{(pid=86497) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 11:13:45 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_93f18296
Nov 14 11:13:45 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO93f18296-4a9dcdf3bbed0ec9
Nov 14 11:13:45 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23461396463646633
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9760942-ed56-4ba9-9211-2495c39b13bc]: (4, None) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8eddf5-6c5e-4fbc-849f-a0c3c90aa111]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d968fc-e848-49f3-93b9-d13b9657207c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]
Nov 14 11:13:45 user nova-compute[75255]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.
Nov 14 11:13:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1365eaf0-1034-4bac-bb27-803766f5bb2b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] <== disconnect_volume: return (340ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:13:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Deleting instance files /opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162_del
Nov 14 11:13:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Deletion of /opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162_del complete
Nov 14 11:13:45 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 63b41a9a-238d-49a9-869b-04f93807a162 could not be found.
Nov 14 11:13:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:13:45 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c400d79-dc76-4281-8831-4eedeb88caea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:13:45 user nova-compute[75255]: No targets found.
Nov 14 11:13:45 user nova-compute[75255]: iSNS:
Nov 14 11:13:45 user nova-compute[75255]: No targets found.
Nov 14 11:13:45 user nova-compute[75255]: STATIC:
Nov 14 11:13:45 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:13:45 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:13:45 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:13:45 user nova-compute[75255]: FIRMWARE:
Nov 14 11:13:45 user nova-compute[75255]: No targets found.
Nov 14 11:13:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:13:45 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:13:45 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaab51b-230e-4268-8c32-88d47cc8fdc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e3af9-3a09-4b3d-ace5-055ec20c2ea3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:13:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:13:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3382125f0>, {}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Disconnecting from: [] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] <== disconnect_volume: return (67ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:13:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Preparing to wait for external event volume-reimaged-db613e9f-f962-4eaf-805c-6801c6686dcd {{(pid=75255) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-e609e4a3-e579-464e-b056-8eb0ab9b32f8 req-5069439f-9865-4923-8626-75bea43edecc service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e609e4a3-e579-464e-b056-8eb0ab9b32f8 req-5069439f-9865-4923-8626-75bea43edecc service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e609e4a3-e579-464e-b056-8eb0ab9b32f8 req-5069439f-9865-4923-8626-75bea43edecc service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e609e4a3-e579-464e-b056-8eb0ab9b32f8 req-5069439f-9865-4923-8626-75bea43edecc service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:13:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-e609e4a3-e579-464e-b056-8eb0ab9b32f8 req-5069439f-9865-4923-8626-75bea43edecc service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No event matching network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd in dict_keys([('volume-reimaged', 'db613e9f-f962-4eaf-805c-6801c6686dcd')]) {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 14 11:13:46 user nova-compute[75255]: WARNING nova.compute.manager [req-e609e4a3-e579-464e-b056-8eb0ab9b32f8 req-5069439f-9865-4923-8626-75bea43edecc service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received unexpected event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with vm_state active and task_state rebuilding.
Nov 14 11:13:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:13:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-3a4d2f53-6349-446c-9919-db90d3c832c7 req-feee64c9-1cb6-4036-b089-b90156007a2e service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event volume-reimaged-db613e9f-f962-4eaf-805c-6801c6686dcd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3a4d2f53-6349-446c-9919-db90d3c832c7 req-feee64c9-1cb6-4036-b089-b90156007a2e service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3a4d2f53-6349-446c-9919-db90d3c832c7 req-feee64c9-1cb6-4036-b089-b90156007a2e service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3a4d2f53-6349-446c-9919-db90d3c832c7 req-feee64c9-1cb6-4036-b089-b90156007a2e service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-3a4d2f53-6349-446c-9919-db90d3c832c7 req-feee64c9-1cb6-4036-b089-b90156007a2e service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Processing event volume-reimaged-db613e9f-f962-4eaf-805c-6801c6686dcd {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:14:01 user nova-compute[75255]: INFO nova.virt.block_device [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Booting with volume db613e9f-f962-4eaf-805c-6801c6686dcd at /dev/vda
Nov 14 11:14:01 user nova-compute[75255]: DEBUG os_brick.utils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cf0a4d-aff0-4fc5-8e88-ef8a7dfcb582]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b8564-71b8-4692-a775-b6651bb28933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87c3364-f62e-4212-b9b7-8ee08980c67f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b11de3e-4eaf-4078-8039-f7be41657639]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:14:01 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:14:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf78f59-9ece-4f37-88bb-17310ff05649]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG os_brick.utils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:14:01 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updating existing volume attachment record: f71405e7-cabe-458a-8f58-dbc99420216b {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:14:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:14:06 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Creating image(s)
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Ensure instance console log exists: /opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Start _get_guest_xml network_info=[{"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f71405e7-cabe-458a-8f58-dbc99420216b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '63b41a9a-238d-49a9-869b-04f93807a162', 'attached_at': '', 'detached_at': '', 'volume_id': 'db613e9f-f962-4eaf-805c-6801c6686dcd', 'serial': 'db613e9f-f962-4eaf-805c-6801c6686dcd'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:14:06 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 11:14:06 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63b41a9a-238d-49a9-869b-04f93807a162 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:14:06 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:14:06 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:14:06 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc090cc-8bc7-4747-97e8-741afbfdaa16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:14:06 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec24ae-8afe-4d90-81b0-8577c708404c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd] added
Nov 14 11:14:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a52009-94b3-4297-96d3-2bad38dbd78b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd5879a-685b-4943-803f-e4950e8bc7f4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdNXElHL {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdNXElHL" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c592f3c-e8ef-4d1b-8289-2aee12d49fc7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdNXElHL'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e38000b-22c8-4e89-8dee-7b36f554aed5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f3a56-d294-47f5-aecb-ea0c3713a06e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4dde6-cba2-412d-908f-da3487381045]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]
Nov 14 11:14:06 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.
Nov 14 11:14:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a7575a-5431-4bef-abce-c37957ab5074]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9130b9c1-f14d-49e2-b527-69a021a6d996]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:06 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:14:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:06 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:14:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbcccb5-bd0f-495a-b5a9-dc241bf26066]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:14:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23461396463646633', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461396463646633', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-447666239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1499633906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwU1xv1xc32UMmh521HPmm6gpJwDUhaPj4v1hgrYr86Gslhx3Uank+yCUbau5rZTLI7k7xw1cjFV4LqT2I3ukBAwJ5YycfeR1ZKh0NIzC0EPgZh24zBPEC2vcJeI8HzNA==',key_name='tempest-keypair-1814893210',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5897376b7cd49f1bd1023adcb84221d',ramdisk_id='',reservation_id='r-x04jsgts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1203206168',owner_user_name='tempest-ServerActionsV293TestJSON-1203206168-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='382ccde674c04896a70d745cb2da3529',uuid=63b41a9a-238d-49a9-869b-04f93807a162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converting VIF {"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:14:07 user nova-compute[75255]:   <uuid>63b41a9a-238d-49a9-869b-04f93807a162</uuid>
Nov 14 11:14:07 user nova-compute[75255]:   <name>instance-00000012</name>
Nov 14 11:14:07 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:14:07 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:14:07 user nova-compute[75255]:   <metadata>
Nov 14 11:14:07 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:14:07 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:14:07 user nova-compute[75255]:       <nova:name>tempest-ServerActionsV293TestJSON-server-447666239</nova:name>
Nov 14 11:14:07 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:14:06</nova:creationTime>
Nov 14 11:14:07 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:14:07 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:14:07 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:14:07 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:14:07 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:14:07 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:14:07 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:14:07 user nova-compute[75255]:       <nova:owner>
Nov 14 11:14:07 user nova-compute[75255]:         <nova:user uuid="382ccde674c04896a70d745cb2da3529">tempest-ServerActionsV293TestJSON-1203206168-project-member</nova:user>
Nov 14 11:14:07 user nova-compute[75255]:         <nova:project uuid="f5897376b7cd49f1bd1023adcb84221d">tempest-ServerActionsV293TestJSON-1203206168</nova:project>
Nov 14 11:14:07 user nova-compute[75255]:       </nova:owner>
Nov 14 11:14:07 user nova-compute[75255]:       <nova:ports>
Nov 14 11:14:07 user nova-compute[75255]:         <nova:port uuid="237b1bfe-ef57-4580-9fa8-55ead0cf29fd">
Nov 14 11:14:07 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 11:14:07 user nova-compute[75255]:         </nova:port>
Nov 14 11:14:07 user nova-compute[75255]:       </nova:ports>
Nov 14 11:14:07 user nova-compute[75255]:     </nova:instance>
Nov 14 11:14:07 user nova-compute[75255]:   </metadata>
Nov 14 11:14:07 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:14:07 user nova-compute[75255]:     <system>
Nov 14 11:14:07 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:14:07 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:14:07 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:14:07 user nova-compute[75255]:       <entry name="serial">63b41a9a-238d-49a9-869b-04f93807a162</entry>
Nov 14 11:14:07 user nova-compute[75255]:       <entry name="uuid">63b41a9a-238d-49a9-869b-04f93807a162</entry>
Nov 14 11:14:07 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:14:07 user nova-compute[75255]:     </system>
Nov 14 11:14:07 user nova-compute[75255]:   </sysinfo>
Nov 14 11:14:07 user nova-compute[75255]:   <os>
Nov 14 11:14:07 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:14:07 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:14:07 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:14:07 user nova-compute[75255]:   </os>
Nov 14 11:14:07 user nova-compute[75255]:   <features>
Nov 14 11:14:07 user nova-compute[75255]:     <acpi/>
Nov 14 11:14:07 user nova-compute[75255]:     <apic/>
Nov 14 11:14:07 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:14:07 user nova-compute[75255]:   </features>
Nov 14 11:14:07 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:14:07 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:14:07 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:14:07 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:14:07 user nova-compute[75255]:   </clock>
Nov 14 11:14:07 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:14:07 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:14:07 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:14:07 user nova-compute[75255]:   </cpu>
Nov 14 11:14:07 user nova-compute[75255]:   <devices>
Nov 14 11:14:07 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:14:07 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:14:07 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:14:07 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:14:07 user nova-compute[75255]:       <serial>db613e9f-f962-4eaf-805c-6801c6686dcd</serial>
Nov 14 11:14:07 user nova-compute[75255]:     </disk>
Nov 14 11:14:07 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:14:07 user nova-compute[75255]:       <mac address="fa:16:3e:33:b9:f2"/>
Nov 14 11:14:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:14:07 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:14:07 user nova-compute[75255]:       <target dev="tap237b1bfe-ef"/>
Nov 14 11:14:07 user nova-compute[75255]:     </interface>
Nov 14 11:14:07 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:14:07 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162/console.log" append="off"/>
Nov 14 11:14:07 user nova-compute[75255]:     </serial>
Nov 14 11:14:07 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:14:07 user nova-compute[75255]:     <video>
Nov 14 11:14:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:14:07 user nova-compute[75255]:     </video>
Nov 14 11:14:07 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:14:07 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:14:07 user nova-compute[75255]:     </rng>
Nov 14 11:14:07 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:14:07 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:14:07 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:14:07 user nova-compute[75255]:     </memballoon>
Nov 14 11:14:07 user nova-compute[75255]:   </devices>
Nov 14 11:14:07 user nova-compute[75255]: </domain>
Nov 14 11:14:07 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-447666239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1499633906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwU1xv1xc32UMmh521HPmm6gpJwDUhaPj4v1hgrYr86Gslhx3Uank+yCUbau5rZTLI7k7xw1cjFV4LqT2I3ukBAwJ5YycfeR1ZKh0NIzC0EPgZh24zBPEC2vcJeI8HzNA==',key_name='tempest-keypair-1814893210',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5897376b7cd49f1bd1023adcb84221d',ramdisk_id='',reservation_id='r-x04jsgts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1203206168',owner_user_name='tempest-ServerActionsV293TestJSON-1203206168-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='382ccde674c04896a70d745cb2da3529',uuid=63b41a9a-238d-49a9-869b-04f93807a162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converting VIF {"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG os_vif [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95db0e99-ad93-54d8-8851-3303c67b1288', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap237b1bfe-ef, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap237b1bfe-ef, col_values=(('qos', UUID('756409f1-0af1-41ca-923b-602b0c9f0e31')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap237b1bfe-ef, col_values=(('external_ids', {'iface-id': '237b1bfe-ef57-4580-9fa8-55ead0cf29fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:b9:f2', 'vm-uuid': '63b41a9a-238d-49a9-869b-04f93807a162'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:07 user nova-compute[75255]: INFO os_vif [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef')
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:14:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] No VIF found with MAC fa:16:3e:33:b9:f2, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-8d7c20d6-d507-490c-a8a8-9cdc2775361e req-9853cde0-01d5-4e42-9aca-7c183442502c service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8d7c20d6-d507-490c-a8a8-9cdc2775361e req-9853cde0-01d5-4e42-9aca-7c183442502c service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8d7c20d6-d507-490c-a8a8-9cdc2775361e req-9853cde0-01d5-4e42-9aca-7c183442502c service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8d7c20d6-d507-490c-a8a8-9cdc2775361e req-9853cde0-01d5-4e42-9aca-7c183442502c service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-8d7c20d6-d507-490c-a8a8-9cdc2775361e req-9853cde0-01d5-4e42-9aca-7c183442502c service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No waiting events found dispatching network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:14:09 user nova-compute[75255]: WARNING nova.compute.manager [req-8d7c20d6-d507-490c-a8a8-9cdc2775361e req-9853cde0-01d5-4e42-9aca-7c183442502c service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received unexpected event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with vm_state active and task_state rebuild_spawning.
Nov 14 11:14:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:14:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance spawned successfully.
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-dbb2c5ad-96cb-4e8f-a152-9dadc42f2469 req-96f5189f-f05e-4714-8c30-0cf45f61d1db service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-dbb2c5ad-96cb-4e8f-a152-9dadc42f2469 req-96f5189f-f05e-4714-8c30-0cf45f61d1db service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-dbb2c5ad-96cb-4e8f-a152-9dadc42f2469 req-96f5189f-f05e-4714-8c30-0cf45f61d1db service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-dbb2c5ad-96cb-4e8f-a152-9dadc42f2469 req-96f5189f-f05e-4714-8c30-0cf45f61d1db service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-dbb2c5ad-96cb-4e8f-a152-9dadc42f2469 req-96f5189f-f05e-4714-8c30-0cf45f61d1db service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No waiting events found dispatching network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:14:11 user nova-compute[75255]: WARNING nova.compute.manager [req-dbb2c5ad-96cb-4e8f-a152-9dadc42f2469 req-96f5189f-f05e-4714-8c30-0cf45f61d1db service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received unexpected event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with vm_state active and task_state rebuild_spawning.
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75255) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 11:14:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a4d2f53-6349-446c-9919-db90d3c832c7 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:14:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:14:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:14:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:14:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:14:30 user nova-compute[75255]: INFO nova.compute.claims [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Claim successful on node user
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.network.neutron [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:14:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.policy [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b82af4602b649889188f0f943c63896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb07eaf3ea24939aeef6eba1bb2293d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:14:31 user nova-compute[75255]: INFO nova.virt.block_device [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Booting with blank volume at /dev/vda
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Successfully created port: 6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Successfully updated port: 6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG nova.network.neutron [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-changed-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Refreshing instance network info cache due to event network-changed-6c7285d5-c7d6-4ad4-8d39-7428e2068659. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] Acquiring lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:14:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG nova.network.neutron [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance network_info: |[{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] Acquired lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG nova.network.neutron [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Refreshing network info cache for port 6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:14:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.26599884033203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updated VIF entry in instance network info cache for port 6c7285d5-c7d6-4ad4-8d39-7428e2068659. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b3de43fc-dc6e-4974-85bf-7949ff9d3fbf req-63fe2359-2a4e-4e8d-976e-af2b2d14d5e8 service nova] Releasing lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 63b41a9a-238d-49a9-869b-04f93807a162 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance cfadd2f1-c323-450c-983d-1af5126fe645 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c965a0f1-c9f3-403e-904d-4c3daf764d1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:14:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG os_brick.utils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ef181-b5e6-41d1-a776-91cb7e3a3cff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[df076fe9-a858-4776-8523-999935aae77f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e945e8b1-28f5-435c-b7f1-839ba98f4185]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[005cdbe1-03d3-46f8-8f8b-6ab6a6301c93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:14:37 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[892e7bb9-fc76-4cc5-b120-eb19785e10ee]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG os_brick.utils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating existing volume attachment record: 1731aa16-72ba-4f9c-b6e0-356d16929d5a {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updating instance_info_cache with network_info: [{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:14:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:14:43 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Creating image(s)
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Ensure instance console log exists: /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Start _get_guest_xml network_info=[{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '1731aa16-72ba-4f9c-b6e0-356d16929d5a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqhYfzRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '427d469e-db0a-48ef-bbed-92e8d7ad61fe', 'attached_at': '', 'detached_at': '', 'volume_id': '59544be6-2339-4966-a957-b0f9dc8c60bd', 'serial': '59544be6-2339-4966-a957-b0f9dc8c60bd'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:14:43 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:14:43 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqhYfzRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:14:43 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:14:43 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:14:43 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[268654ff-6b46-4f58-976c-8b871001c842]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:14:43 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[156f50dd-8e5f-45a6-8317-43c2b2bc0e7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd] added
Nov 14 11:14:43 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[21550095-9ad1-434c-a024-0e1c3fe47afc]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[32976833-171a-4a3a-83d3-6a4620f99df3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqhYfzRu {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqhYfzRu" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d7c2e-684d-4d5d-af0d-54acc29c336e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqhYfzRu'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[89610f12-bfc1-41f4-bf98-020c7f92ef5c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6136700a-3016-4ee7-a9e0-f7eebae7ef33]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:43 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:14:43 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:43 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:14:43 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be98ac5-f8e6-40d6-ac64-22a60b802b78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260]
Nov 14 11:14:43 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260] successful.
Nov 14 11:14:43 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd4bed6-e937-4aa9-ad7b-cd09b10dc423]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1907b949-5318-491c-a6c5-7920b43cc065]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:43 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:14:43 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:14:43 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:14:43 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:14:43 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:14:43 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08e6758-6cf5-4123-89bf-729557d82394]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:14:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqhYfzRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23131623531366465', 'path': '/dev/sdd'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131623531366465', 'path': '/dev/sdd'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1426869663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1426869663',id=22,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-h01gegs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:14:32Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=427d469e-db0a-48ef-bbed-92e8d7ad61fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.objects.instance [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'pci_devices' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:14:44 user nova-compute[75255]:   <uuid>427d469e-db0a-48ef-bbed-92e8d7ad61fe</uuid>
Nov 14 11:14:44 user nova-compute[75255]:   <name>instance-00000016</name>
Nov 14 11:14:44 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:14:44 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:14:44 user nova-compute[75255]:   <metadata>
Nov 14 11:14:44 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:14:44 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:14:44 user nova-compute[75255]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1426869663</nova:name>
Nov 14 11:14:44 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:14:43</nova:creationTime>
Nov 14 11:14:44 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:14:44 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:14:44 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:14:44 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:14:44 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:14:44 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:14:44 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:14:44 user nova-compute[75255]:       <nova:owner>
Nov 14 11:14:44 user nova-compute[75255]:         <nova:user uuid="3b82af4602b649889188f0f943c63896">tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member</nova:user>
Nov 14 11:14:44 user nova-compute[75255]:         <nova:project uuid="bbb07eaf3ea24939aeef6eba1bb2293d">tempest-ServerBootFromVolumeStableRescueTest-1912178200</nova:project>
Nov 14 11:14:44 user nova-compute[75255]:       </nova:owner>
Nov 14 11:14:44 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:14:44 user nova-compute[75255]:       <nova:ports>
Nov 14 11:14:44 user nova-compute[75255]:         <nova:port uuid="6c7285d5-c7d6-4ad4-8d39-7428e2068659">
Nov 14 11:14:44 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:14:44 user nova-compute[75255]:         </nova:port>
Nov 14 11:14:44 user nova-compute[75255]:       </nova:ports>
Nov 14 11:14:44 user nova-compute[75255]:     </nova:instance>
Nov 14 11:14:44 user nova-compute[75255]:   </metadata>
Nov 14 11:14:44 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:14:44 user nova-compute[75255]:     <system>
Nov 14 11:14:44 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:14:44 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:14:44 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:14:44 user nova-compute[75255]:       <entry name="serial">427d469e-db0a-48ef-bbed-92e8d7ad61fe</entry>
Nov 14 11:14:44 user nova-compute[75255]:       <entry name="uuid">427d469e-db0a-48ef-bbed-92e8d7ad61fe</entry>
Nov 14 11:14:44 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:14:44 user nova-compute[75255]:     </system>
Nov 14 11:14:44 user nova-compute[75255]:   </sysinfo>
Nov 14 11:14:44 user nova-compute[75255]:   <os>
Nov 14 11:14:44 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:14:44 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:14:44 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:14:44 user nova-compute[75255]:   </os>
Nov 14 11:14:44 user nova-compute[75255]:   <features>
Nov 14 11:14:44 user nova-compute[75255]:     <acpi/>
Nov 14 11:14:44 user nova-compute[75255]:     <apic/>
Nov 14 11:14:44 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:14:44 user nova-compute[75255]:   </features>
Nov 14 11:14:44 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:14:44 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:14:44 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:14:44 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:14:44 user nova-compute[75255]:   </clock>
Nov 14 11:14:44 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:14:44 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:14:44 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:14:44 user nova-compute[75255]:   </cpu>
Nov 14 11:14:44 user nova-compute[75255]:   <devices>
Nov 14 11:14:44 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:14:44 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:14:44 user nova-compute[75255]:       <source dev="/dev/sdd"/>
Nov 14 11:14:44 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:14:44 user nova-compute[75255]:       <serial>59544be6-2339-4966-a957-b0f9dc8c60bd</serial>
Nov 14 11:14:44 user nova-compute[75255]:     </disk>
Nov 14 11:14:44 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:14:44 user nova-compute[75255]:       <mac address="fa:16:3e:bb:d8:f7"/>
Nov 14 11:14:44 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:14:44 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:14:44 user nova-compute[75255]:       <target dev="tap6c7285d5-c7"/>
Nov 14 11:14:44 user nova-compute[75255]:     </interface>
Nov 14 11:14:44 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:14:44 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/console.log" append="off"/>
Nov 14 11:14:44 user nova-compute[75255]:     </serial>
Nov 14 11:14:44 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:14:44 user nova-compute[75255]:     <video>
Nov 14 11:14:44 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:14:44 user nova-compute[75255]:     </video>
Nov 14 11:14:44 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:14:44 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:14:44 user nova-compute[75255]:     </rng>
Nov 14 11:14:44 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:14:44 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:14:44 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:14:44 user nova-compute[75255]:     </memballoon>
Nov 14 11:14:44 user nova-compute[75255]:   </devices>
Nov 14 11:14:44 user nova-compute[75255]: </domain>
Nov 14 11:14:44 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1426869663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1426869663',id=22,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-h01gegs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:14:32Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=427d469e-db0a-48ef-bbed-92e8d7ad61fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG os_vif [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd20a153b-c4a7-550e-987e-5b218592da65', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c7285d5-c7, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c7285d5-c7, col_values=(('qos', UUID('bbdc9924-73fd-4a2c-8b74-90b21a29df84')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c7285d5-c7, col_values=(('external_ids', {'iface-id': '6c7285d5-c7d6-4ad4-8d39-7428e2068659', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:d8:f7', 'vm-uuid': '427d469e-db0a-48ef-bbed-92e8d7ad61fe'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:14:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:44 user nova-compute[75255]: INFO os_vif [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7')
Nov 14 11:14:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:14:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No VIF found with MAC fa:16:3e:bb:d8:f7, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d5b7b66-9ec3-42df-84cd-af55d1e563ff req-e18dc7fa-55df-48e5-a5fd-d9201fb98406 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d5b7b66-9ec3-42df-84cd-af55d1e563ff req-e18dc7fa-55df-48e5-a5fd-d9201fb98406 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d5b7b66-9ec3-42df-84cd-af55d1e563ff req-e18dc7fa-55df-48e5-a5fd-d9201fb98406 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d5b7b66-9ec3-42df-84cd-af55d1e563ff req-e18dc7fa-55df-48e5-a5fd-d9201fb98406 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d5b7b66-9ec3-42df-84cd-af55d1e563ff req-e18dc7fa-55df-48e5-a5fd-d9201fb98406 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:14:46 user nova-compute[75255]: WARNING nova.compute.manager [req-7d5b7b66-9ec3-42df-84cd-af55d1e563ff req-e18dc7fa-55df-48e5-a5fd-d9201fb98406 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state building and task_state spawning.
Nov 14 11:14:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-68e21822-14e0-4f30-aea1-29cefe405cab req-ea0af57b-b00f-48d1-be33-e19c209b1579 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-68e21822-14e0-4f30-aea1-29cefe405cab req-ea0af57b-b00f-48d1-be33-e19c209b1579 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-68e21822-14e0-4f30-aea1-29cefe405cab req-ea0af57b-b00f-48d1-be33-e19c209b1579 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-68e21822-14e0-4f30-aea1-29cefe405cab req-ea0af57b-b00f-48d1-be33-e19c209b1579 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-68e21822-14e0-4f30-aea1-29cefe405cab req-ea0af57b-b00f-48d1-be33-e19c209b1579 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:14:48 user nova-compute[75255]: WARNING nova.compute.manager [req-68e21822-14e0-4f30-aea1-29cefe405cab req-ea0af57b-b00f-48d1-be33-e19c209b1579 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state building and task_state spawning.
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:14:48 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance spawned successfully.
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:14:48 user nova-compute[75255]: INFO nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 14 11:14:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:14:48 user nova-compute[75255]: INFO nova.compute.manager [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Took 18.21 seconds to build instance.
Nov 14 11:14:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-36e859dd-a30d-4fdc-afa1-e666132904ac tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.322s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:14:54 user nova-compute[75255]: INFO nova.compute.claims [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Claim successful on node user
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:14:54 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.policy [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c7ed01376d41ac9b99ba698909e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a3c374e68a4ec483ff0a15298b1bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:14:54 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Creating image(s)
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk 1073741824" returned: 0 in 0.052s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Successfully created port: fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Cannot resize image /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Ensure instance console log exists: /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Successfully updated port: fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing instance network info cache due to event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] Acquiring lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance network_info: |[{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] Acquired lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Start _get_guest_xml network_info=[{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:14:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:14:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-601843745',display_name='tempest-ServerRescueNegativeTestJSON-server-601843745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-601843745',id=23,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXbThBksLRb7OJ/ZqAWmSa7CpRhp6HVt9MtrWqjBQuNdICzPnlAUwWGwrQkljFKbWOMwvEByCdSwGK9oOQbw28XpMokcEie6HNS3TlH5BwHKRbIQm6fefmSlTyorBkkOQ==',key_name='tempest-keypair-527098458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-3um6ny4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=7bae2ca8-f0e2-4b1c-8153-0836383dab5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:14:56 user nova-compute[75255]:   <uuid>7bae2ca8-f0e2-4b1c-8153-0836383dab5d</uuid>
Nov 14 11:14:56 user nova-compute[75255]:   <name>instance-00000017</name>
Nov 14 11:14:56 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:14:56 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:14:56 user nova-compute[75255]:   <metadata>
Nov 14 11:14:56 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:14:56 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:14:56 user nova-compute[75255]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-601843745</nova:name>
Nov 14 11:14:56 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:14:56</nova:creationTime>
Nov 14 11:14:56 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:14:56 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:14:56 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:14:56 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:14:56 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:14:56 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:14:56 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:14:56 user nova-compute[75255]:       <nova:owner>
Nov 14 11:14:56 user nova-compute[75255]:         <nova:user uuid="13c7ed01376d41ac9b99ba698909e8bf">tempest-ServerRescueNegativeTestJSON-2135406154-project-member</nova:user>
Nov 14 11:14:56 user nova-compute[75255]:         <nova:project uuid="e4a3c374e68a4ec483ff0a15298b1bff">tempest-ServerRescueNegativeTestJSON-2135406154</nova:project>
Nov 14 11:14:56 user nova-compute[75255]:       </nova:owner>
Nov 14 11:14:56 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:14:56 user nova-compute[75255]:       <nova:ports>
Nov 14 11:14:56 user nova-compute[75255]:         <nova:port uuid="fc0b9ee4-f968-428a-be9c-48b6a5b83339">
Nov 14 11:14:56 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 11:14:56 user nova-compute[75255]:         </nova:port>
Nov 14 11:14:56 user nova-compute[75255]:       </nova:ports>
Nov 14 11:14:56 user nova-compute[75255]:     </nova:instance>
Nov 14 11:14:56 user nova-compute[75255]:   </metadata>
Nov 14 11:14:56 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:14:56 user nova-compute[75255]:     <system>
Nov 14 11:14:56 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:14:56 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:14:56 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:14:56 user nova-compute[75255]:       <entry name="serial">7bae2ca8-f0e2-4b1c-8153-0836383dab5d</entry>
Nov 14 11:14:56 user nova-compute[75255]:       <entry name="uuid">7bae2ca8-f0e2-4b1c-8153-0836383dab5d</entry>
Nov 14 11:14:56 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:14:56 user nova-compute[75255]:     </system>
Nov 14 11:14:56 user nova-compute[75255]:   </sysinfo>
Nov 14 11:14:56 user nova-compute[75255]:   <os>
Nov 14 11:14:56 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:14:56 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:14:56 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:14:56 user nova-compute[75255]:   </os>
Nov 14 11:14:56 user nova-compute[75255]:   <features>
Nov 14 11:14:56 user nova-compute[75255]:     <acpi/>
Nov 14 11:14:56 user nova-compute[75255]:     <apic/>
Nov 14 11:14:56 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:14:56 user nova-compute[75255]:   </features>
Nov 14 11:14:56 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:14:56 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:14:56 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:14:56 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:14:56 user nova-compute[75255]:   </clock>
Nov 14 11:14:56 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:14:56 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:14:56 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:14:56 user nova-compute[75255]:   </cpu>
Nov 14 11:14:56 user nova-compute[75255]:   <devices>
Nov 14 11:14:56 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:14:56 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:14:56 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk"/>
Nov 14 11:14:56 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:14:56 user nova-compute[75255]:     </disk>
Nov 14 11:14:56 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:14:56 user nova-compute[75255]:       <mac address="fa:16:3e:6b:25:a0"/>
Nov 14 11:14:56 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:14:56 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:14:56 user nova-compute[75255]:       <target dev="tapfc0b9ee4-f9"/>
Nov 14 11:14:56 user nova-compute[75255]:     </interface>
Nov 14 11:14:56 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:14:56 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/console.log" append="off"/>
Nov 14 11:14:56 user nova-compute[75255]:     </serial>
Nov 14 11:14:56 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:14:56 user nova-compute[75255]:     <video>
Nov 14 11:14:56 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:14:56 user nova-compute[75255]:     </video>
Nov 14 11:14:56 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:14:56 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:14:56 user nova-compute[75255]:     </rng>
Nov 14 11:14:56 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:14:56 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:14:56 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:14:56 user nova-compute[75255]:     </memballoon>
Nov 14 11:14:56 user nova-compute[75255]:   </devices>
Nov 14 11:14:56 user nova-compute[75255]: </domain>
Nov 14 11:14:56 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-601843745',display_name='tempest-ServerRescueNegativeTestJSON-server-601843745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-601843745',id=23,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXbThBksLRb7OJ/ZqAWmSa7CpRhp6HVt9MtrWqjBQuNdICzPnlAUwWGwrQkljFKbWOMwvEByCdSwGK9oOQbw28XpMokcEie6HNS3TlH5BwHKRbIQm6fefmSlTyorBkkOQ==',key_name='tempest-keypair-527098458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-3um6ny4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=7bae2ca8-f0e2-4b1c-8153-0836383dab5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG os_vif [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '699d5b50-a722-58c6-a97f-782f8ddef620', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc0b9ee4-f9, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc0b9ee4-f9, col_values=(('qos', UUID('61db256e-f727-4014-ac93-ba193f94b7cf')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc0b9ee4-f9, col_values=(('external_ids', {'iface-id': 'fc0b9ee4-f968-428a-be9c-48b6a5b83339', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:25:a0', 'vm-uuid': '7bae2ca8-f0e2-4b1c-8153-0836383dab5d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:56 user nova-compute[75255]: INFO os_vif [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9')
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No VIF found with MAC fa:16:3e:6b:25:a0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-changed-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Refreshing instance network info cache due to event network-changed-a2fae558-9762-487f-8242-60321fa137ec. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] Acquiring lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] Acquired lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Refreshing network info cache for port a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updated VIF entry in instance network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:14:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-eda8f910-cccf-4a60-ab83-ac019c31feed req-230fdb74-4c19-4cae-b272-f054d9efd529 service nova] Releasing lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:14:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Updated VIF entry in instance network info cache for port a2fae558-9762-487f-8242-60321fa137ec. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:14:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Updating instance_info_cache with network_info: [{"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:14:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ab17b0b0-53e9-4bdb-a549-c74c77e8a1ef req-e66e2afd-17c5-4055-9b06-b312455088a4 service nova] Releasing lock "refresh_cache-cfadd2f1-c323-450c-983d-1af5126fe645" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:14:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG nova.objects.instance [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid cfadd2f1-c323-450c-983d-1af5126fe645 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:58 user nova-compute[75255]: INFO nova.compute.manager [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Attaching volume 73228878-0b03-46b7-a905-a2aeece720cb to /dev/vdb
Nov 14 11:14:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42775b0-710c-4a61-9fdb-ff055d22291f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2fe57-7736-455f-bddd-1f6583f3b8a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30ce048-ddde-4719-89e1-4388efbcca27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a584ba-17d0-4824-9283-3ce2386cc671]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:14:58 user nova-compute[75255]: WARNING nova.compute.manager [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state building and task_state spawning.
Nov 14 11:14:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:14:58 user nova-compute[75255]: WARNING nova.compute.manager [req-961a2bc7-d2ab-4b82-b618-bfedd9292895 req-f4420537-3ab3-462f-81d1-c6563f3abe32 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state building and task_state spawning.
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:14:58 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:14:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a63e64-0b4f-4f7f-bc35-debdb7e487db]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:14:58 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Updating existing volume attachment record: b612b23b-2c46-48e1-b138-82a326151aed {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:14:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:14:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:15:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance spawned successfully.
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:00 user nova-compute[75255]: INFO nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 14 11:15:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:15:00 user nova-compute[75255]: INFO nova.compute.manager [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Took 6.03 seconds to build instance.
Nov 14 11:15:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f85b4998-0f33-469b-9607-15c03c3f8c98 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.120s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:02 user nova-compute[75255]: INFO nova.compute.manager [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Terminating instance
Nov 14 11:15:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:15:02 user nova-compute[75255]: INFO nova.compute.claims [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Claim successful on node user
Nov 14 11:15:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-cd6c035f-3608-4ad3-8acd-de156d713e95 req-e6453412-9947-49f4-bb2a-de1081126f7c service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cd6c035f-3608-4ad3-8acd-de156d713e95 req-e6453412-9947-49f4-bb2a-de1081126f7c service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cd6c035f-3608-4ad3-8acd-de156d713e95 req-e6453412-9947-49f4-bb2a-de1081126f7c service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cd6c035f-3608-4ad3-8acd-de156d713e95 req-e6453412-9947-49f4-bb2a-de1081126f7c service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-cd6c035f-3608-4ad3-8acd-de156d713e95 req-e6453412-9947-49f4-bb2a-de1081126f7c service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-cd6c035f-3608-4ad3-8acd-de156d713e95 req-e6453412-9947-49f4-bb2a-de1081126f7c service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-unplugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:15:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Instance destroyed successfully.
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lazy-loading 'resources' on Instance uuid 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1199255564',display_name='tempest-ServerActionsTestOtherB-server-1199255564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1199255564',id=3,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu8iVMb4focVJ52/ZfcWTW6TRvFW0X0OY33FhtfbbhyuwCHuAc2MQ4f7q9ShEWl++vZ+Z/X6L+04QgMZipGKjYF0SM4JM4Rip9N60ZopNGYGZnAoCpcjMgkIHIFvtQS4g==',key_name='tempest-keypair-1697946655',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b3a9d5daf4b497a8a85e435e91f1727',ramdisk_id='',reservation_id='r-cqlagd1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1009587932',owner_user_name='tempest-ServerActionsTestOtherB-1009587932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cafcd6055544bcbd86f3015db594f2',uuid=26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converting VIF {"id": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "address": "fa:16:3e:47:a1:19", "network": {"id": "a1cb50c1-c3bc-4f9d-83d8-06d95562c21a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2010252972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b3a9d5daf4b497a8a85e435e91f1727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8730dcdf-d2", "ovs_interfaceid": "8730dcdf-d2cb-4be1-aa6a-299cb1b955bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_vif [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8730dcdf-d2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.policy [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51df3343a8524c14ac4788217825a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb2db5b35b344b4a0f939695dda98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0147011-a30a-4806-88f3-c0d009d2df41) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:03 user nova-compute[75255]: INFO os_vif [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:a1:19,bridge_name='br-int',has_traffic_filtering=True,id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf,network=Network(a1cb50c1-c3bc-4f9d-83d8-06d95562c21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8730dcdf-d2')
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXFtywBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:03 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fb0afb-6a71-4056-88df-3344cb5f37c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:15:03 user nova-compute[75255]: No targets found.
Nov 14 11:15:03 user nova-compute[75255]: iSNS:
Nov 14 11:15:03 user nova-compute[75255]: No targets found.
Nov 14 11:15:03 user nova-compute[75255]: STATIC:
Nov 14 11:15:03 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:15:03 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:03 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:03 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:15:03 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:03 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:03 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655
Nov 14 11:15:03 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:03 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:03 user nova-compute[75255]: FIRMWARE:
Nov 14 11:15:03 user nova-compute[75255]: No targets found.
Nov 14 11:15:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:15:03 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:15:03 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:15:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Creating image(s)
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "/opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "/opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22b768-fd9a-42c5-a89f-8e723a99baed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtgowYpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:03 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374cf18-3c0b-420a-8c50-38f16617b24c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:15:03 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:03 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 (non-flash)
Nov 14 11:15:03 user nova-compute[75255]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:03 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3380d5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93b613-8bc7-4c18-9182-1f12a87d81b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19daa90-5f78-4b45-88ac-3509a2a21803]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3facf933-26e5-4b93-ad1e-09a28a3d3266]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb83e3-8d9c-4eda-9f06-3066078960ca]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.206s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aa94d3-4f1a-45ee-a2f1-78ada8ea1177]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3424ede-5f87-4787-a0c2-dc8e8c92fc1a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260]
Nov 14 11:15:03 user nova-compute[75255]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655, portal: 172.16.0.220,3260] successful.
Nov 14 11:15:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4655b965-55d1-4c75-af86-8a8caabfe655 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f701bc-1bc1-4a82-ac9d-b6297484927a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] <== disconnect_volume: return (387ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:15:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Deleting instance files /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c_del
Nov 14 11:15:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Deletion of /opt/stack/data/nova/instances/26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c_del complete
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.303s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:03 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:03 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb68f27-8d9b-4de0-a459-207273909fde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:15:03 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ba11a6-8cb7-400d-98ff-ca6a73d98b2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb] added
Nov 14 11:15:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk 1073741824" returned: 0 in 0.076s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51604f07-08f0-4d6c-9b9c-0169d3395eeb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Successfully created port: 52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:15:03 user nova-compute[75255]: INFO nova.compute.manager [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7686e-a628-4dc1-8e2b-968485457eb9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:15:03 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtgowYpT {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtgowYpT" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb3d38b-8f0d-4efa-b3d2-e65144e5041f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xtgowYpT'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30698b-e1b2-4991-a432-6c13cc59da0a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e05147-8cb8-4560-bc68-6c7169bb03ad]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.215s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2135b239-6948-414c-bb1b-7430fc38fdda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260]
Nov 14 11:15:04 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260] successful.
Nov 14 11:15:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a407f9-6adf-4192-8d4e-6010840a0b2d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[685635e9-3c1a-4959-a6c4-a906bdc16b9d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:04 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[97997d87-5d7a-4206-9367-787c339e60a6]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtgowYpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Cannot resize image /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Ensure instance console log exists: /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Successfully updated port: 52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "refresh_cache-3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquired lock "refresh_cache-3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received event network-changed-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Refreshing instance network info cache due to event network-changed-52c00153-0443-4fdc-8252-fb0f04bae1d2. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] Acquiring lock "refresh_cache-3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-63793ce8-3bec-41dd-bd4a-80900190c7a0 req-cebc4845-9ef8-452d-94b7-0158d7091962 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-deleted-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:04 user nova-compute[75255]: INFO nova.compute.manager [req-63793ce8-3bec-41dd-bd4a-80900190c7a0 req-cebc4845-9ef8-452d-94b7-0158d7091962 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Neutron deleted interface 8730dcdf-d2cb-4be1-aa6a-299cb1b955bf; detaching it from the instance and deleting it from the info cache
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.network.neutron [req-63793ce8-3bec-41dd-bd4a-80900190c7a0 req-cebc4845-9ef8-452d-94b7-0158d7091962 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:04 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Took 0.97 seconds to deallocate network for instance.
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-63793ce8-3bec-41dd-bd4a-80900190c7a0 req-cebc4845-9ef8-452d-94b7-0158d7091962 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Detach interface failed, port_id=8730dcdf-d2cb-4be1-aa6a-299cb1b955bf, reason: Instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-a9fa7ac0-788a-4796-9424-159513db6f39 req-46264cc5-9b35-4ee5-be3b-2c738a624236 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9fa7ac0-788a-4796-9424-159513db6f39 req-46264cc5-9b35-4ee5-be3b-2c738a624236 service nova] Acquiring lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9fa7ac0-788a-4796-9424-159513db6f39 req-46264cc5-9b35-4ee5-be3b-2c738a624236 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9fa7ac0-788a-4796-9424-159513db6f39 req-46264cc5-9b35-4ee5-be3b-2c738a624236 service nova] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-a9fa7ac0-788a-4796-9424-159513db6f39 req-46264cc5-9b35-4ee5-be3b-2c738a624236 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] No waiting events found dispatching network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:04 user nova-compute[75255]: WARNING nova.compute.manager [req-a9fa7ac0-788a-4796-9424-159513db6f39 req-46264cc5-9b35-4ee5-be3b-2c738a624236 service nova] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Received unexpected event network-vif-plugged-8730dcdf-d2cb-4be1-aa6a-299cb1b955bf for instance with vm_state active and task_state deleting.
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Updating instance_info_cache with network_info: [{"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Releasing lock "refresh_cache-3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Instance network_info: |[{"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] Acquired lock "refresh_cache-3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Refreshing network info cache for port 52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Start _get_guest_xml network_info=[{"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:15:05 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:15:05 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-423940193',display_name='tempest-VolumesActionsTest-instance-423940193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-423940193',id=24,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feb2db5b35b344b4a0f939695dda98ec',ramdisk_id='',reservation_id='r-qz0wbwy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934295409',owner_user_name='tempest-VolumesActionsTest-1934295409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:15:03Z,user_data=None,user_id='51df3343a8524c14ac4788217825a99f',uuid=3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converting VIF {"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a1:8b,bridge_name='br-int',has_traffic_filtering=True,id=52c00153-0443-4fdc-8252-fb0f04bae1d2,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c00153-04') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.objects.instance [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:15:05 user nova-compute[75255]:   <uuid>3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a</uuid>
Nov 14 11:15:05 user nova-compute[75255]:   <name>instance-00000018</name>
Nov 14 11:15:05 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:15:05 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:15:05 user nova-compute[75255]:   <metadata>
Nov 14 11:15:05 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:15:05 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:15:05 user nova-compute[75255]:       <nova:name>tempest-VolumesActionsTest-instance-423940193</nova:name>
Nov 14 11:15:05 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:15:05</nova:creationTime>
Nov 14 11:15:05 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:15:05 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:15:05 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:15:05 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:15:05 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:15:05 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:15:05 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:15:05 user nova-compute[75255]:       <nova:owner>
Nov 14 11:15:05 user nova-compute[75255]:         <nova:user uuid="51df3343a8524c14ac4788217825a99f">tempest-VolumesActionsTest-1934295409-project-member</nova:user>
Nov 14 11:15:05 user nova-compute[75255]:         <nova:project uuid="feb2db5b35b344b4a0f939695dda98ec">tempest-VolumesActionsTest-1934295409</nova:project>
Nov 14 11:15:05 user nova-compute[75255]:       </nova:owner>
Nov 14 11:15:05 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:15:05 user nova-compute[75255]:       <nova:ports>
Nov 14 11:15:05 user nova-compute[75255]:         <nova:port uuid="52c00153-0443-4fdc-8252-fb0f04bae1d2">
Nov 14 11:15:05 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:15:05 user nova-compute[75255]:         </nova:port>
Nov 14 11:15:05 user nova-compute[75255]:       </nova:ports>
Nov 14 11:15:05 user nova-compute[75255]:     </nova:instance>
Nov 14 11:15:05 user nova-compute[75255]:   </metadata>
Nov 14 11:15:05 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:15:05 user nova-compute[75255]:     <system>
Nov 14 11:15:05 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:15:05 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:15:05 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:15:05 user nova-compute[75255]:       <entry name="serial">3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a</entry>
Nov 14 11:15:05 user nova-compute[75255]:       <entry name="uuid">3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a</entry>
Nov 14 11:15:05 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:15:05 user nova-compute[75255]:     </system>
Nov 14 11:15:05 user nova-compute[75255]:   </sysinfo>
Nov 14 11:15:05 user nova-compute[75255]:   <os>
Nov 14 11:15:05 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:15:05 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:15:05 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:15:05 user nova-compute[75255]:   </os>
Nov 14 11:15:05 user nova-compute[75255]:   <features>
Nov 14 11:15:05 user nova-compute[75255]:     <acpi/>
Nov 14 11:15:05 user nova-compute[75255]:     <apic/>
Nov 14 11:15:05 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:15:05 user nova-compute[75255]:   </features>
Nov 14 11:15:05 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:15:05 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:15:05 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:15:05 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:15:05 user nova-compute[75255]:   </clock>
Nov 14 11:15:05 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:15:05 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:15:05 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:15:05 user nova-compute[75255]:   </cpu>
Nov 14 11:15:05 user nova-compute[75255]:   <devices>
Nov 14 11:15:05 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:15:05 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:15:05 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk"/>
Nov 14 11:15:05 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:15:05 user nova-compute[75255]:     </disk>
Nov 14 11:15:05 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:15:05 user nova-compute[75255]:       <mac address="fa:16:3e:49:a1:8b"/>
Nov 14 11:15:05 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:15:05 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:15:05 user nova-compute[75255]:       <target dev="tap52c00153-04"/>
Nov 14 11:15:05 user nova-compute[75255]:     </interface>
Nov 14 11:15:05 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:15:05 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/console.log" append="off"/>
Nov 14 11:15:05 user nova-compute[75255]:     </serial>
Nov 14 11:15:05 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:15:05 user nova-compute[75255]:     <video>
Nov 14 11:15:05 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:15:05 user nova-compute[75255]:     </video>
Nov 14 11:15:05 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:15:05 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:15:05 user nova-compute[75255]:     </rng>
Nov 14 11:15:05 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:15:05 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:15:05 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:15:05 user nova-compute[75255]:     </memballoon>
Nov 14 11:15:05 user nova-compute[75255]:   </devices>
Nov 14 11:15:05 user nova-compute[75255]: </domain>
Nov 14 11:15:05 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-423940193',display_name='tempest-VolumesActionsTest-instance-423940193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-423940193',id=24,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feb2db5b35b344b4a0f939695dda98ec',ramdisk_id='',reservation_id='r-qz0wbwy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934295409',owner_user_name='tempest-VolumesActionsTest-1934295409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:15:03Z,user_data=None,user_id='51df3343a8524c14ac4788217825a99f',uuid=3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converting VIF {"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a1:8b,bridge_name='br-int',has_traffic_filtering=True,id=52c00153-0443-4fdc-8252-fb0f04bae1d2,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c00153-04') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG os_vif [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a1:8b,bridge_name='br-int',has_traffic_filtering=True,id=52c00153-0443-4fdc-8252-fb0f04bae1d2,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c00153-04') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af37f7ef-4cdc-57b5-aceb-7aa0c77188bc', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52c00153-04, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52c00153-04, col_values=(('qos', UUID('510b57d9-79c3-4d59-ba64-6f14da9f47fe')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52c00153-04, col_values=(('external_ids', {'iface-id': '52c00153-0443-4fdc-8252-fb0f04bae1d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:a1:8b', 'vm-uuid': '3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:05 user nova-compute[75255]: INFO os_vif [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a1:8b,bridge_name='br-int',has_traffic_filtering=True,id=52c00153-0443-4fdc-8252-fb0f04bae1d2,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c00153-04')
Nov 14 11:15:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== connect_volume: return (1773ms) {'type': 'block', 'scsi_wwn': '23836343061663862', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836343061663862', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.objects.instance [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid cfadd2f1-c323-450c-983d-1af5126fe645 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] No VIF found with MAC fa:16:3e:49:a1:8b, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:15:05 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:15:05 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:15:05 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:15:05 user nova-compute[75255]:   <serial>73228878-0b03-46b7-a905-a2aeece720cb</serial>
Nov 14 11:15:05 user nova-compute[75255]: </disk>
Nov 14 11:15:05 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Updated VIF entry in instance network info cache for port 52c00153-0443-4fdc-8252-fb0f04bae1d2. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Updating instance_info_cache with network_info: [{"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7c694a1f-0f1d-4867-b9af-8ec3e417b9d3 req-3d5b7046-e716-4684-9f86-1242eb92eaf0 service nova] Releasing lock "refresh_cache-3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:05 user nova-compute[75255]: INFO nova.compute.manager [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] [instance: 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 11:15:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:06 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Deleted allocations for instance 26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c
Nov 14 11:15:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a15ec656-a657-4124-a2d8-3496aa59a53a tempest-ServerActionsTestOtherB-1009587932 tempest-ServerActionsTestOtherB-1009587932-project-member] Lock "26cae14e-c98a-4e61-a8ee-f0bcb3eeea2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.744s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No VIF found with MAC fa:16:3e:2f:a7:5d, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-47746fe7-5b7d-43dc-acf4-d485923bb1d0 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.921s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-97ac31ab-f081-4d81-ae42-9dea70ee708e req-d76ebb9e-76ee-4146-b593-db4fe88e7802 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received event network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-97ac31ab-f081-4d81-ae42-9dea70ee708e req-d76ebb9e-76ee-4146-b593-db4fe88e7802 service nova] Acquiring lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-97ac31ab-f081-4d81-ae42-9dea70ee708e req-d76ebb9e-76ee-4146-b593-db4fe88e7802 service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-97ac31ab-f081-4d81-ae42-9dea70ee708e req-d76ebb9e-76ee-4146-b593-db4fe88e7802 service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-97ac31ab-f081-4d81-ae42-9dea70ee708e req-d76ebb9e-76ee-4146-b593-db4fe88e7802 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] No waiting events found dispatching network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:07 user nova-compute[75255]: WARNING nova.compute.manager [req-97ac31ab-f081-4d81-ae42-9dea70ee708e req-d76ebb9e-76ee-4146-b593-db4fe88e7802 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received unexpected event network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 for instance with vm_state building and task_state spawning.
Nov 14 11:15:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:07 user nova-compute[75255]: INFO nova.compute.manager [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Detaching volume 73228878-0b03-46b7-a905-a2aeece720cb
Nov 14 11:15:07 user nova-compute[75255]: INFO nova.virt.block_device [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Attempting to driver detach volume 73228878-0b03-46b7-a905-a2aeece720cb from mountpoint /dev/vdb
Nov 14 11:15:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Attempting to detach device vdb from instance cfadd2f1-c323-450c-983d-1af5126fe645 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:15:07 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:15:07 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:15:07 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:15:07 user nova-compute[75255]:   <serial>73228878-0b03-46b7-a905-a2aeece720cb</serial>
Nov 14 11:15:07 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:15:07 user nova-compute[75255]: </disk>
Nov 14 11:15:07 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:15:07 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully detached device vdb from instance cfadd2f1-c323-450c-983d-1af5126fe645 from the persistent domain config.
Nov 14 11:15:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfadd2f1-c323-450c-983d-1af5126fe645 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:15:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:15:07 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:15:07 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:15:07 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:15:07 user nova-compute[75255]:   <serial>73228878-0b03-46b7-a905-a2aeece720cb</serial>
Nov 14 11:15:07 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:15:07 user nova-compute[75255]: </disk>
Nov 14 11:15:07 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:15:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfadd2f1-c323-450c-983d-1af5126fe645 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.objects.instance [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'flavor' on Instance uuid c27772f3-df22-4b0b-bb50-8fdf8de7c846 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-16ab264a-1728-415b-a0e2-5bd52e05ec14 req-03309117-eadc-42de-b8e3-fcdb82102356 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received event network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-16ab264a-1728-415b-a0e2-5bd52e05ec14 req-03309117-eadc-42de-b8e3-fcdb82102356 service nova] Acquiring lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-16ab264a-1728-415b-a0e2-5bd52e05ec14 req-03309117-eadc-42de-b8e3-fcdb82102356 service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-16ab264a-1728-415b-a0e2-5bd52e05ec14 req-03309117-eadc-42de-b8e3-fcdb82102356 service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-16ab264a-1728-415b-a0e2-5bd52e05ec14 req-03309117-eadc-42de-b8e3-fcdb82102356 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] No waiting events found dispatching network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:09 user nova-compute[75255]: WARNING nova.compute.manager [req-16ab264a-1728-415b-a0e2-5bd52e05ec14 req-03309117-eadc-42de-b8e3-fcdb82102356 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received unexpected event network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 for instance with vm_state building and task_state spawning.
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:15:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Instance spawned successfully.
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:09 user nova-compute[75255]: INFO nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:09 user nova-compute[75255]: INFO nova.compute.manager [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Attaching volume 41b41a48-88b1-4f91-b2e0-26f7454d5e81 to /dev/vdb
Nov 14 11:15:09 user nova-compute[75255]: DEBUG os_brick.utils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47c6785-0af0-45ca-af46-9d97764775e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[18723f72-0381-473e-832f-7a0b0f534b56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:09 user nova-compute[75255]: INFO nova.compute.manager [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Took 7.00 seconds to build instance.
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b362b63e-317f-4ea4-81b2-c2ab8b929986 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.100s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a51de-09aa-4458-9bd0-7b6df3c1d801]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3910bf-1672-42aa-b02c-a11bc91ebf77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:15:09 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:15:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3184bf07-327d-4552-b6be-d1121f94e76d]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG os_brick.utils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:09 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating existing volume attachment record: 9710c146-d869-45e4-9b5d-448dcfeefc9b {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:15:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSRAUjkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:14 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:14 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:14 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[121ecdb1-57de-4a65-b3cf-6a72f526ce8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:15:14 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f885bd-9cda-42c3-b285-e9943fd1b58f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81] added
Nov 14 11:15:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fd80e3-2249-4779-a8b1-5fc8053b7bda]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c6e85f-5117-41f8-8540-a8c390d0601c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSRAUjkF {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSRAUjkF" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dde2165-8d36-4b1b-995e-deae7527934e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QSRAUjkF'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d775b1-5136-46af-b0d3-9161114c52af]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbe79fc-a0df-44ee-b458-88979e13cde8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac6049-a7f9-41bd-8726-584e392aacfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260]
Nov 14 11:15:14 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260] successful.
Nov 14 11:15:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b727d4b-f044-4784-9b1e-614b669b93c1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04e83d-726e-45cb-8513-70dc09210cd1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:14 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c654dd92-7399-47b6-98aa-be11e0bd7ed4]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:15:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSRAUjkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:15:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23631386661633832', 'path': '/dev/sde'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631386661633832', 'path': '/dev/sde'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:15:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'flavor' on Instance uuid c27772f3-df22-4b0b-bb50-8fdf8de7c846 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:15:15 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:15:15 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:15:15 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:15:15 user nova-compute[75255]:   <serial>41b41a48-88b1-4f91-b2e0-26f7454d5e81</serial>
Nov 14 11:15:15 user nova-compute[75255]: </disk>
Nov 14 11:15:15 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:15:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] No VIF found with MAC fa:16:3e:07:f0:0c, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:15:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-07bf3fa0-1657-4ea5-ab9b-3705b7bfb8cf tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.807s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing instance network info cache due to event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updated VIF entry in instance network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f11d39b9-1e91-48f0-a25b-1be917c3b380 req-f949c1ad-3ced-4ef6-af3b-404f6d3b2c5a service nova] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:15:20 user nova-compute[75255]: INFO nova.compute.claims [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Claim successful on node user
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.network.neutron [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:15:20 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:15:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.policy [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31467e0715d645ecbfbb209e8eba66ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1dfe665b5444728fff969e0156d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:15:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Creating image(s)
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk 1073741824" returned: 0 in 0.053s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Successfully created port: 1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing instance network info cache due to event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.network.neutron [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Cannot resize image /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Ensure instance console log exists: /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG nova.network.neutron [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updated VIF entry in instance network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG nova.network.neutron [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e2b8888b-97de-4d09-9587-63ea667ecaf4 req-c8f7ee11-9497-4f62-913a-153e225033f9 service nova] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:22 user nova-compute[75255]: INFO nova.compute.manager [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Rebooting instance
Nov 14 11:15:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:22 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Successfully updated port: 1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquired lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-changed-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Refreshing instance network info cache due to event network-changed-1aac53ad-ce4c-44b3-a42c-d947e908163a. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] Acquiring lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updating instance_info_cache with network_info: [{"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Releasing lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance network_info: |[{"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] Acquired lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.neutron [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Refreshing network info cache for port 1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Start _get_guest_xml network_info=[{"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:15:23 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:15:23 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1601762684',display_name='tempest-tempest.common.compute-instance-1601762684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1601762684',id=25,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhcx8OgnnF0sgX7lf5Bb/Ju9ZNs5VH3jSw48Yyf9PzYERs0enurSVnV4ZbPhgypn+lr+5fCW5y+08OCGzhvWHfPpd7bjdumzk5JuaEuMh4lWf12uun4pcHA18MdN3akUA==',key_name='tempest-keypair-1173659248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-33uqdt3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=9057f65e-8951-49ad-963c-a62d9a8a1724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.objects.instance [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'pci_devices' on Instance uuid 9057f65e-8951-49ad-963c-a62d9a8a1724 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:15:23 user nova-compute[75255]:   <uuid>9057f65e-8951-49ad-963c-a62d9a8a1724</uuid>
Nov 14 11:15:23 user nova-compute[75255]:   <name>instance-00000019</name>
Nov 14 11:15:23 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:15:23 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:15:23 user nova-compute[75255]:   <metadata>
Nov 14 11:15:23 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:15:23 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:15:23 user nova-compute[75255]:       <nova:name>tempest-tempest.common.compute-instance-1601762684</nova:name>
Nov 14 11:15:23 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:15:23</nova:creationTime>
Nov 14 11:15:23 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:15:23 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:15:23 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:15:23 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:15:23 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:15:23 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:15:23 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:15:23 user nova-compute[75255]:       <nova:owner>
Nov 14 11:15:23 user nova-compute[75255]:         <nova:user uuid="31467e0715d645ecbfbb209e8eba66ed">tempest-ServerActionsTestOtherA-1585033744-project-member</nova:user>
Nov 14 11:15:23 user nova-compute[75255]:         <nova:project uuid="3d1dfe665b5444728fff969e0156d205">tempest-ServerActionsTestOtherA-1585033744</nova:project>
Nov 14 11:15:23 user nova-compute[75255]:       </nova:owner>
Nov 14 11:15:23 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:15:23 user nova-compute[75255]:       <nova:ports>
Nov 14 11:15:23 user nova-compute[75255]:         <nova:port uuid="1aac53ad-ce4c-44b3-a42c-d947e908163a">
Nov 14 11:15:23 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:15:23 user nova-compute[75255]:         </nova:port>
Nov 14 11:15:23 user nova-compute[75255]:       </nova:ports>
Nov 14 11:15:23 user nova-compute[75255]:     </nova:instance>
Nov 14 11:15:23 user nova-compute[75255]:   </metadata>
Nov 14 11:15:23 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:15:23 user nova-compute[75255]:     <system>
Nov 14 11:15:23 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:15:23 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:15:23 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:15:23 user nova-compute[75255]:       <entry name="serial">9057f65e-8951-49ad-963c-a62d9a8a1724</entry>
Nov 14 11:15:23 user nova-compute[75255]:       <entry name="uuid">9057f65e-8951-49ad-963c-a62d9a8a1724</entry>
Nov 14 11:15:23 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:15:23 user nova-compute[75255]:     </system>
Nov 14 11:15:23 user nova-compute[75255]:   </sysinfo>
Nov 14 11:15:23 user nova-compute[75255]:   <os>
Nov 14 11:15:23 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:15:23 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:15:23 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:15:23 user nova-compute[75255]:   </os>
Nov 14 11:15:23 user nova-compute[75255]:   <features>
Nov 14 11:15:23 user nova-compute[75255]:     <acpi/>
Nov 14 11:15:23 user nova-compute[75255]:     <apic/>
Nov 14 11:15:23 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:15:23 user nova-compute[75255]:   </features>
Nov 14 11:15:23 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:15:23 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:15:23 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:15:23 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:15:23 user nova-compute[75255]:   </clock>
Nov 14 11:15:23 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:15:23 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:15:23 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:15:23 user nova-compute[75255]:   </cpu>
Nov 14 11:15:23 user nova-compute[75255]:   <devices>
Nov 14 11:15:23 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:15:23 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:15:23 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk"/>
Nov 14 11:15:23 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:15:23 user nova-compute[75255]:     </disk>
Nov 14 11:15:23 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:15:23 user nova-compute[75255]:       <mac address="fa:16:3e:78:56:18"/>
Nov 14 11:15:23 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:15:23 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:15:23 user nova-compute[75255]:       <target dev="tap1aac53ad-ce"/>
Nov 14 11:15:23 user nova-compute[75255]:     </interface>
Nov 14 11:15:23 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:15:23 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/console.log" append="off"/>
Nov 14 11:15:23 user nova-compute[75255]:     </serial>
Nov 14 11:15:23 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:15:23 user nova-compute[75255]:     <video>
Nov 14 11:15:23 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:15:23 user nova-compute[75255]:     </video>
Nov 14 11:15:23 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:15:23 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:15:23 user nova-compute[75255]:     </rng>
Nov 14 11:15:23 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:15:23 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:15:23 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:15:23 user nova-compute[75255]:     </memballoon>
Nov 14 11:15:23 user nova-compute[75255]:   </devices>
Nov 14 11:15:23 user nova-compute[75255]: </domain>
Nov 14 11:15:23 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1601762684',display_name='tempest-tempest.common.compute-instance-1601762684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1601762684',id=25,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhcx8OgnnF0sgX7lf5Bb/Ju9ZNs5VH3jSw48Yyf9PzYERs0enurSVnV4ZbPhgypn+lr+5fCW5y+08OCGzhvWHfPpd7bjdumzk5JuaEuMh4lWf12uun4pcHA18MdN3akUA==',key_name='tempest-keypair-1173659248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-33uqdt3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=9057f65e-8951-49ad-963c-a62d9a8a1724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG os_vif [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '649634a5-f1f1-533b-a683-6ffc2ff6404c', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aac53ad-ce, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aac53ad-ce, col_values=(('qos', UUID('0334de96-10d9-4e7d-a8c7-054fcfe8caf2')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aac53ad-ce, col_values=(('external_ids', {'iface-id': '1aac53ad-ce4c-44b3-a42c-d947e908163a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:56:18', 'vm-uuid': '9057f65e-8951-49ad-963c-a62d9a8a1724'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:23 user nova-compute[75255]: INFO os_vif [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce')
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No VIF found with MAC fa:16:3e:78:56:18, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:15:24 user nova-compute[75255]: DEBUG nova.network.neutron [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updated VIF entry in instance network info cache for port 1aac53ad-ce4c-44b3-a42c-d947e908163a. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:15:24 user nova-compute[75255]: DEBUG nova.network.neutron [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updating instance_info_cache with network_info: [{"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ae063ff0-f9a0-42ce-94be-4e9075761d1e req-369d7cb2-9201-4700-9c09-3674c2e8322f service nova] Releasing lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lazy-loading 'flavor' on Instance uuid c965a0f1-c9f3-403e-904d-4c3daf764d1f {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:25 user nova-compute[75255]: INFO nova.compute.manager [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Attaching volume 148a883b-9470-4284-afcc-a4e309bc241e to /dev/vdb
Nov 14 11:15:25 user nova-compute[75255]: DEBUG os_brick.utils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abdadc8-ab39-4ea7-88d2-f6b69efa7a40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa08e6-ca34-4e99-aff8-75ff5c94c1d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6739774a-ab42-4854-a204-7bfef4b9eafe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0768e0-8de9-4c46-acae-d542e851e8c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-d85814c5-ee6f-40fe-8653-a5272ab107e1 req-76cc2d91-6304-4a53-a732-5ade7a43e862 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d85814c5-ee6f-40fe-8653-a5272ab107e1 req-76cc2d91-6304-4a53-a732-5ade7a43e862 service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d85814c5-ee6f-40fe-8653-a5272ab107e1 req-76cc2d91-6304-4a53-a732-5ade7a43e862 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d85814c5-ee6f-40fe-8653-a5272ab107e1 req-76cc2d91-6304-4a53-a732-5ade7a43e862 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-d85814c5-ee6f-40fe-8653-a5272ab107e1 req-76cc2d91-6304-4a53-a732-5ade7a43e862 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:25 user nova-compute[75255]: WARNING nova.compute.manager [req-d85814c5-ee6f-40fe-8653-a5272ab107e1 req-76cc2d91-6304-4a53-a732-5ade7a43e862 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received unexpected event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with vm_state building and task_state spawning.
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:15:25 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:15:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee02fc9-c7dc-4b1b-80be-81e24d921eb0]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG os_brick.utils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Updating existing volume attachment record: e8a846f5-16d2-4587-941b-4b0c1732bb80 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:26 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance shutdown successfully.
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:15:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance spawned successfully.
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:27 user nova-compute[75255]: WARNING nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received unexpected event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with vm_state building and task_state spawning.
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-unplugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-unplugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:27 user nova-compute[75255]: WARNING nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received unexpected event network-vif-unplugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with vm_state active and task_state reboot_started.
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:27 user nova-compute[75255]: WARNING nova.compute.manager [req-7d62bef4-4d2e-42e7-866b-8dc729599d54 req-bd800daf-28d1-48e7-83d8-dd92f47e8101 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received unexpected event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with vm_state active and task_state reboot_started.
Nov 14 11:15:27 user nova-compute[75255]: INFO nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 14 11:15:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:15:27 user nova-compute[75255]: INFO nova.compute.manager [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Took 7.19 seconds to build instance.
Nov 14 11:15:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-401dceb4-ca5e-406b-b11a-48a8a0c762b5 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.281s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:28 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cfadd2f1-c323-450c-983d-1af5126fe645 is timed out.
Nov 14 11:15:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully detached device vdb from instance cfadd2f1-c323-450c-983d-1af5126fe645 from the live domain config.
Nov 14 11:15:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtgowYpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:28 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e99b80-077d-4b95-99d3-94d3d6fb33de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:15:28 user nova-compute[75255]: No targets found.
Nov 14 11:15:28 user nova-compute[75255]: iSNS:
Nov 14 11:15:28 user nova-compute[75255]: No targets found.
Nov 14 11:15:28 user nova-compute[75255]: STATIC:
Nov 14 11:15:28 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:15:28 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:28 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:28 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81
Nov 14 11:15:28 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:28 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:28 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb
Nov 14 11:15:28 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:28 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:28 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:15:28 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:28 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:28 user nova-compute[75255]: FIRMWARE:
Nov 14 11:15:28 user nova-compute[75255]: No targets found.
Nov 14 11:15:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:15:28 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:15:28 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0685d9a6-21ab-4359-b45b-0ba1db18be21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef87d7d-d09d-4427-ac67-460f79bd027c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:28 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:28 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:28 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:28 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:28 user nova-compute[75255]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb (non-flash)
Nov 14 11:15:28 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff328222a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a982d6-9e96-4c7f-bfdd-dbd08bc73652]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1241a4-c8b5-4f43-b941-ee7bb578c431]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12ba326-1d7f-40a2-905f-f6ccc7d144de]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3d177-d137-47f6-b9de-ce7175ea4a0b]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61997b1-aab7-4b24-a344-2c32dfb006ac]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[72098975-949c-4cb9-a8f3-d2ac20425fc9]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260]
Nov 14 11:15:28 user nova-compute[75255]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb, portal: 172.16.0.220,3260] successful.
Nov 14 11:15:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73228878-0b03-46b7-a905-a2aeece720cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[845dbe13-bbc1-4f01-ad49-a8d97607461d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== disconnect_volume: return (319ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:15:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid cfadd2f1-c323-450c-983d-1af5126fe645 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f2d7b2ca-c7d5-4f05-bf9b-8037cd388796 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:29 user nova-compute[75255]: WARNING nova.compute.manager [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received unexpected event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with vm_state active and task_state reboot_started.
Nov 14 11:15:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:29 user nova-compute[75255]: WARNING nova.compute.manager [req-6295689e-c3fe-46e0-8ece-f2eb629e60c1 req-34558939-cc8a-43f2-95c6-191e7f204a57 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received unexpected event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with vm_state active and task_state reboot_started.
Nov 14 11:15:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drPIyReV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:30 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:30 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:30 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa99c1d7-6280-4f39-9c68-6937abb8b87a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:15:30 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57c510-e8be-46d4-a499-43373da4aa6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e] added
Nov 14 11:15:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c374caf-c07a-43c0-9941-d69422c09686]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7935f3-3925-4cb1-8986-22400e43009d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drPIyReV {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drPIyReV" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[858fceb6-56ae-4443-8c19-a5cd703c202b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'drPIyReV'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance running successfully.
Nov 14 11:15:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance soft rebooted successfully.
Nov 14 11:15:30 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3814031e-8d19-46a5-8731-ae0192be5f8c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d127c46a-44dd-4c47-a5a6-b01dba1e06fc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f659d744-73ad-44d1-a1cc-b14356915b8b tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.762s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26f63d2-dab9-4b3a-b8e1-7cd29299af41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260]
Nov 14 11:15:30 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260] successful.
Nov 14 11:15:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0991dfdc-4f82-48d3-9d67-fc6a539ffbee]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[593ab298-5be3-4826-b76a-bcafff91bf00]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e (non-flash)
Nov 14 11:15:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:30 user nova-compute[75255]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e (non-flash)
Nov 14 11:15:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e4422-067c-45a2-bd53-a4aff1fcf7b9]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drPIyReV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26434653632313335', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434653632313335', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lazy-loading 'flavor' on Instance uuid c965a0f1-c9f3-403e-904d-4c3daf764d1f {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:15:31 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:15:31 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:15:31 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:15:31 user nova-compute[75255]:   <serial>148a883b-9470-4284-afcc-a4e309bc241e</serial>
Nov 14 11:15:31 user nova-compute[75255]: </disk>
Nov 14 11:15:31 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:15:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] No VIF found with MAC fa:16:3e:92:e3:02, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5cb50648-df43-4c48-be4e-acfff4c627e1 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.953s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:32 user nova-compute[75255]: INFO nova.compute.manager [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Terminating instance
Nov 14 11:15:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-83f5bb31-3818-43a1-a10a-5ab28ae8bfcd req-d0b0ff20-6a61-4594-a2aa-0fd80c420b9c service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received event network-vif-unplugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-83f5bb31-3818-43a1-a10a-5ab28ae8bfcd req-d0b0ff20-6a61-4594-a2aa-0fd80c420b9c service nova] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-83f5bb31-3818-43a1-a10a-5ab28ae8bfcd req-d0b0ff20-6a61-4594-a2aa-0fd80c420b9c service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-83f5bb31-3818-43a1-a10a-5ab28ae8bfcd req-d0b0ff20-6a61-4594-a2aa-0fd80c420b9c service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-83f5bb31-3818-43a1-a10a-5ab28ae8bfcd req-d0b0ff20-6a61-4594-a2aa-0fd80c420b9c service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] No waiting events found dispatching network-vif-unplugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-83f5bb31-3818-43a1-a10a-5ab28ae8bfcd req-d0b0ff20-6a61-4594-a2aa-0fd80c420b9c service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received event network-vif-unplugged-9e48dea4-df18-4c77-b834-fb779d0da13c for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Instance destroyed successfully.
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.objects.instance [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lazy-loading 'resources' on Instance uuid c965a0f1-c9f3-403e-904d-4c3daf764d1f {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-643314655',display_name='tempest-DeleteServersTestJSON-server-643314655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-643314655',id=21,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:13:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21c4a2ca3bf344d8a0ea69c79c51fce0',ramdisk_id='',reservation_id='r-r2sz8qs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1653490136',owner_user_name='tempest-DeleteServersTestJSON-1653490136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:13:40Z,user_data=None,user_id='4912cae05e5648bfbee95a1b0db00c09',uuid=c965a0f1-c9f3-403e-904d-4c3daf764d1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Converting VIF {"id": "9e48dea4-df18-4c77-b834-fb779d0da13c", "address": "fa:16:3e:92:e3:02", "network": {"id": "0824b5f3-bebd-4071-b8be-3bdf01ab4619", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1437773582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21c4a2ca3bf344d8a0ea69c79c51fce0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e48dea4-df", "ovs_interfaceid": "9e48dea4-df18-4c77-b834-fb779d0da13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e3:02,bridge_name='br-int',has_traffic_filtering=True,id=9e48dea4-df18-4c77-b834-fb779d0da13c,network=Network(0824b5f3-bebd-4071-b8be-3bdf01ab4619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e48dea4-df') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG os_vif [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e3:02,bridge_name='br-int',has_traffic_filtering=True,id=9e48dea4-df18-4c77-b834-fb779d0da13c,network=Network(0824b5f3-bebd-4071-b8be-3bdf01ab4619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e48dea4-df') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e48dea4-df, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da616a16-860f-43c4-8d89-4c579f3b07ec) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:33 user nova-compute[75255]: INFO os_vif [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e3:02,bridge_name='br-int',has_traffic_filtering=True,id=9e48dea4-df18-4c77-b834-fb779d0da13c,network=Network(0824b5f3-bebd-4071-b8be-3bdf01ab4619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e48dea4-df')
Nov 14 11:15:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drPIyReV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:33 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14891ae-f0c9-4900-a4f5-7b84acf2fd60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:15:34 user nova-compute[75255]: No targets found.
Nov 14 11:15:34 user nova-compute[75255]: iSNS:
Nov 14 11:15:34 user nova-compute[75255]: No targets found.
Nov 14 11:15:34 user nova-compute[75255]: STATIC:
Nov 14 11:15:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:15:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81
Nov 14 11:15:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:15:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e
Nov 14 11:15:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:34 user nova-compute[75255]: FIRMWARE:
Nov 14 11:15:34 user nova-compute[75255]: No targets found.
Nov 14 11:15:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:15:34 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:15:34 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8132ce55-8a6f-436c-b95f-5d8670c47f86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaa0064-3acb-4bc1-b820-be2e8f041213]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:34 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:34 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:34 user nova-compute[75255]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e (non-flash)
Nov 14 11:15:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:34 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:34 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:34 user nova-compute[75255]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e (non-flash)
Nov 14 11:15:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086bde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec3dc60-61f4-431e-9b29-46622301a7df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9538f2f3-73a7-489c-914e-754832cb831e]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2ced8-6776-42f0-9b0d-f7865472eaa6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ae9c1b-b2ee-426d-8c4f-8dff4cb48d53]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e3910b-94d6-423a-b111-b23108756255]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c831381e-1126-45d8-b62a-0acc64150130]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260]
Nov 14 11:15:34 user nova-compute[75255]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e, portal: 172.16.0.220,3260] successful.
Nov 14 11:15:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148a883b-9470-4284-afcc-a4e309bc241e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eb8b01-9726-4cc9-a983-cda87b6cc56d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] <== disconnect_volume: return (368ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:15:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Deleting instance files /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f_del
Nov 14 11:15:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Deletion of /opt/stack/data/nova/instances/c965a0f1-c9f3-403e-904d-4c3daf764d1f_del complete
Nov 14 11:15:34 user nova-compute[75255]: INFO nova.compute.manager [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:34 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'c965a0f1-c9f3-403e-904d-4c3daf764d1f' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c965a0f1-c9f3-403e-904d-4c3daf764d1f' (instance-00000015)
Nov 14 11:15:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:35 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Took 0.69 seconds to deallocate network for instance.
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-2c08ee42-8128-4049-a711-923c8babddd6 req-c76bd567-f438-451a-99f6-ded85efd9e93 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received event network-vif-deleted-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:35 user nova-compute[75255]: INFO nova.compute.manager [req-2c08ee42-8128-4049-a711-923c8babddd6 req-c76bd567-f438-451a-99f6-ded85efd9e93 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Neutron deleted interface 9e48dea4-df18-4c77-b834-fb779d0da13c; detaching it from the instance and deleting it from the info cache
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.network.neutron [req-2c08ee42-8128-4049-a711-923c8babddd6 req-c76bd567-f438-451a-99f6-ded85efd9e93 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-2c08ee42-8128-4049-a711-923c8babddd6 req-c76bd567-f438-451a-99f6-ded85efd9e93 service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Detach interface failed, port_id=9e48dea4-df18-4c77-b834-fb779d0da13c, reason: Instance c965a0f1-c9f3-403e-904d-4c3daf764d1f could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-993800ae-28b6-42a1-8a68-fe7ee3a31b8e req-f39b0004-9b57-490e-9b2f-eef39496654d service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received event network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-993800ae-28b6-42a1-8a68-fe7ee3a31b8e req-f39b0004-9b57-490e-9b2f-eef39496654d service nova] Acquiring lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-993800ae-28b6-42a1-8a68-fe7ee3a31b8e req-f39b0004-9b57-490e-9b2f-eef39496654d service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-993800ae-28b6-42a1-8a68-fe7ee3a31b8e req-f39b0004-9b57-490e-9b2f-eef39496654d service nova] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-993800ae-28b6-42a1-8a68-fe7ee3a31b8e req-f39b0004-9b57-490e-9b2f-eef39496654d service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] No waiting events found dispatching network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:35 user nova-compute[75255]: WARNING nova.compute.manager [req-993800ae-28b6-42a1-8a68-fe7ee3a31b8e req-f39b0004-9b57-490e-9b2f-eef39496654d service nova] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Received unexpected event network-vif-plugged-9e48dea4-df18-4c77-b834-fb779d0da13c for instance with vm_state active and task_state deleting.
Nov 14 11:15:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:15:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7478MB free_disk=25.223262786865234GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:35 user nova-compute[75255]: INFO nova.compute.manager [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Terminating instance
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 63b41a9a-238d-49a9-869b-04f93807a162 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance cfadd2f1-c323-450c-983d-1af5126fe645 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c965a0f1-c9f3-403e-904d-4c3daf764d1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9057f65e-8951-49ad-963c-a62d9a8a1724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:15:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:36 user nova-compute[75255]: INFO nova.compute.manager [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] [instance: c965a0f1-c9f3-403e-904d-4c3daf764d1f] Took 0.87 seconds to detach 1 volumes for instance.
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.367s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Instance destroyed successfully.
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.objects.instance [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lazy-loading 'resources' on Instance uuid 63b41a9a-238d-49a9-869b-04f93807a162 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-447666239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1499633906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwU1xv1xc32UMmh521HPmm6gpJwDUhaPj4v1hgrYr86Gslhx3Uank+yCUbau5rZTLI7k7xw1cjFV4LqT2I3ukBAwJ5YycfeR1ZKh0NIzC0EPgZh24zBPEC2vcJeI8HzNA==',key_name='tempest-keypair-1814893210',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:14:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5897376b7cd49f1bd1023adcb84221d',ramdisk_id='',reservation_id='r-x04jsgts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1203206168',owner_user_name='tempest-ServerActionsV293TestJSON-1203206168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='382ccde674c04896a70d745cb2da3529',uuid=63b41a9a-238d-49a9-869b-04f93807a162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converting VIF {"id": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "address": "fa:16:3e:33:b9:f2", "network": {"id": "a37bd682-7aa8-4257-99e3-8be3ea07dfd8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-72524692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5897376b7cd49f1bd1023adcb84221d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237b1bfe-ef", "ovs_interfaceid": "237b1bfe-ef57-4580-9fa8-55ead0cf29fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_vif [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap237b1bfe-ef, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=756409f1-0af1-41ca-923b-602b0c9f0e31) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:36 user nova-compute[75255]: INFO os_vif [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd,network=Network(a37bd682-7aa8-4257-99e3-8be3ea07dfd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237b1bfe-ef')
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdNXElHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:15:36 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9226ae67-4a7a-49b1-bf6e-a9d782ae0f9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:15:36 user nova-compute[75255]: No targets found.
Nov 14 11:15:36 user nova-compute[75255]: iSNS:
Nov 14 11:15:36 user nova-compute[75255]: No targets found.
Nov 14 11:15:36 user nova-compute[75255]: STATIC:
Nov 14 11:15:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd
Nov 14 11:15:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81
Nov 14 11:15:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:15:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:15:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:15:36 user nova-compute[75255]: FIRMWARE:
Nov 14 11:15:36 user nova-compute[75255]: No targets found.
Nov 14 11:15:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:15:36 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:15:36 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80eadab-41c6-4ab5-8342-6d368ebc3f46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faf193b-de9b-4a00-a388-7b457b244819]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:36 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:36 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd (non-flash)
Nov 14 11:15:36 user nova-compute[75255]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:15:36 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:15:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c54c7c-3b95-441a-9c90-7f3062f5f729]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b14fb84-e6be-4e1b-9a37-ecf3e33b44e6]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff5f02a-2eba-43aa-9fb5-89e9a8cd9099]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d55a05-678c-40d1-a308-f790fb5822d9]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d81bf2-2eec-403a-8d76-4e74353ba40b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Deleted allocations for instance c965a0f1-c9f3-403e-904d-4c3daf764d1f
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e161505f-3add-49d8-ad34-ec1176a2176e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260]
Nov 14 11:15:36 user nova-compute[75255]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd, portal: 172.16.0.220,3260] successful.
Nov 14 11:15:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db613e9f-f962-4eaf-805c-6801c6686dcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc1434-692a-4cd9-a151-10e6d35bead5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] <== disconnect_volume: return (313ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:15:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:15:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Deleting instance files /opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162_del
Nov 14 11:15:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Deletion of /opt/stack/data/nova/instances/63b41a9a-238d-49a9-869b-04f93807a162_del complete
Nov 14 11:15:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9921f9e1-8ac8-40ef-beb9-866b5d627126 tempest-DeleteServersTestJSON-1653490136 tempest-DeleteServersTestJSON-1653490136-project-member] Lock "c965a0f1-c9f3-403e-904d-4c3daf764d1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.031s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:37 user nova-compute[75255]: INFO nova.compute.manager [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-unplugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No waiting events found dispatching network-vif-unplugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-unplugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] Acquiring lock "63b41a9a-238d-49a9-869b-04f93807a162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] Lock "63b41a9a-238d-49a9-869b-04f93807a162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] No waiting events found dispatching network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:37 user nova-compute[75255]: WARNING nova.compute.manager [req-1db015b2-fa21-44f8-ab94-6160d4fa2f29 req-0aad86fd-dd7a-40ef-aefb-75f130171e74 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received unexpected event network-vif-plugged-237b1bfe-ef57-4580-9fa8-55ead0cf29fd for instance with vm_state active and task_state deleting.
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:37 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Took 0.67 seconds to deallocate network for instance.
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-1e61bdb3-dd93-4061-a13c-3497800a7716 req-22b8953b-b698-4d15-bd1d-94312ebe1513 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Received event network-vif-deleted-237b1bfe-ef57-4580-9fa8-55ead0cf29fd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:37 user nova-compute[75255]: INFO nova.compute.manager [req-1e61bdb3-dd93-4061-a13c-3497800a7716 req-22b8953b-b698-4d15-bd1d-94312ebe1513 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Neutron deleted interface 237b1bfe-ef57-4580-9fa8-55ead0cf29fd; detaching it from the instance and deleting it from the info cache
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.network.neutron [req-1e61bdb3-dd93-4061-a13c-3497800a7716 req-22b8953b-b698-4d15-bd1d-94312ebe1513 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-1e61bdb3-dd93-4061-a13c-3497800a7716 req-22b8953b-b698-4d15-bd1d-94312ebe1513 service nova] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Detach interface failed, port_id=237b1bfe-ef57-4580-9fa8-55ead0cf29fd, reason: Instance 63b41a9a-238d-49a9-869b-04f93807a162 could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:15:38 user nova-compute[75255]: INFO nova.compute.manager [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 11:15:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] [instance: 63b41a9a-238d-49a9-869b-04f93807a162] Deleting volume: db613e9f-f962-4eaf-805c-6801c6686dcd {{(pid=75255) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updating instance_info_cache with network_info: [{"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:15:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:15:39 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:15:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:39 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:15:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:39 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Deleted allocations for instance 63b41a9a-238d-49a9-869b-04f93807a162
Nov 14 11:15:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-71e3e72c-3922-4b54-b771-6bef48d3a4d2 tempest-ServerActionsV293TestJSON-1203206168 tempest-ServerActionsV293TestJSON-1203206168-project-member] Lock "63b41a9a-238d-49a9-869b-04f93807a162" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.556s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:58 user nova-compute[75255]: INFO nova.compute.manager [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Terminating instance
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-d01d183c-18e6-47ad-875e-bbad341c48dc req-715ac7fd-90af-4300-b5ca-dd1701fe2534 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-vif-unplugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d01d183c-18e6-47ad-875e-bbad341c48dc req-715ac7fd-90af-4300-b5ca-dd1701fe2534 service nova] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d01d183c-18e6-47ad-875e-bbad341c48dc req-715ac7fd-90af-4300-b5ca-dd1701fe2534 service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d01d183c-18e6-47ad-875e-bbad341c48dc req-715ac7fd-90af-4300-b5ca-dd1701fe2534 service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-d01d183c-18e6-47ad-875e-bbad341c48dc req-715ac7fd-90af-4300-b5ca-dd1701fe2534 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] No waiting events found dispatching network-vif-unplugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-d01d183c-18e6-47ad-875e-bbad341c48dc req-715ac7fd-90af-4300-b5ca-dd1701fe2534 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-vif-unplugged-a2fae558-9762-487f-8242-60321fa137ec for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Instance destroyed successfully.
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.objects.instance [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'resources' on Instance uuid cfadd2f1-c323-450c-983d-1af5126fe645 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1328729552',display_name='tempest-AttachVolumeNegativeTest-server-1328729552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1328729552',id=19,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnYGqPsPbTsyZmE5Wv8rUDCxOh9pEZcO89jrf2XrDqY0QUULvb+rG4tlRWroYlBLWTlbW7VwE+UB9Z2NCaycwZBifx22iWY0SHxLzFuAw7aj+wSNyCU4TwXqE3h8iqKNA==',key_name='tempest-keypair-593539062',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-2yuhvjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=cfadd2f1-c323-450c-983d-1af5126fe645,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "a2fae558-9762-487f-8242-60321fa137ec", "address": "fa:16:3e:2f:a7:5d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fae558-97", "ovs_interfaceid": "a2fae558-9762-487f-8242-60321fa137ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=a2fae558-9762-487f-8242-60321fa137ec,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fae558-97') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG os_vif [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=a2fae558-9762-487f-8242-60321fa137ec,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fae558-97') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2fae558-97, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b2d82ed-23d0-4491-8aea-17825a495c92) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:15:58 user nova-compute[75255]: INFO os_vif [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=a2fae558-9762-487f-8242-60321fa137ec,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fae558-97')
Nov 14 11:15:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Deleting instance files /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645_del
Nov 14 11:15:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Deletion of /opt/stack/data/nova/instances/cfadd2f1-c323-450c-983d-1af5126fe645_del complete
Nov 14 11:15:58 user nova-compute[75255]: INFO nova.compute.manager [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 11:15:58 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:15:58 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:15:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:15:59 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:15:59 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Took 0.95 seconds to deallocate network for instance.
Nov 14 11:15:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-f7d17cda-a046-4122-b0e9-831a17083197 req-23960788-d84f-4a40-8bf4-1c13bcb77e42 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-vif-deleted-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:15:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:15:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:00 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Deleted allocations for instance cfadd2f1-c323-450c-983d-1af5126fe645
Nov 14 11:16:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b22c508b-d0c7-4fee-9b4a-2c81e82cea5a tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "cfadd2f1-c323-450c-983d-1af5126fe645" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-6d751f99-3967-488d-b059-d5c46f52b5a4 req-4c4a6864-c3af-49fd-af45-e72dd4cda6b9 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received event network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6d751f99-3967-488d-b059-d5c46f52b5a4 req-4c4a6864-c3af-49fd-af45-e72dd4cda6b9 service nova] Acquiring lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6d751f99-3967-488d-b059-d5c46f52b5a4 req-4c4a6864-c3af-49fd-af45-e72dd4cda6b9 service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6d751f99-3967-488d-b059-d5c46f52b5a4 req-4c4a6864-c3af-49fd-af45-e72dd4cda6b9 service nova] Lock "cfadd2f1-c323-450c-983d-1af5126fe645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-6d751f99-3967-488d-b059-d5c46f52b5a4 req-4c4a6864-c3af-49fd-af45-e72dd4cda6b9 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] No waiting events found dispatching network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:00 user nova-compute[75255]: WARNING nova.compute.manager [req-6d751f99-3967-488d-b059-d5c46f52b5a4 req-4c4a6864-c3af-49fd-af45-e72dd4cda6b9 service nova] [instance: cfadd2f1-c323-450c-983d-1af5126fe645] Received unexpected event network-vif-plugged-a2fae558-9762-487f-8242-60321fa137ec for instance with vm_state deleted and task_state None.
Nov 14 11:16:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:16:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:16:07 user nova-compute[75255]: INFO nova.compute.claims [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Claim successful on node user
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:16:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.policy [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7197d75a463840b38c24f31bda6b5ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a5377fc1334955bebb27aeeecdcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:16:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Creating image(s)
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk 1073741824" returned: 0 in 0.045s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:16:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Successfully created port: 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Cannot resize image /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Ensure instance console log exists: /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Successfully updated port: 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquired lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing instance network info cache due to event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] Acquiring lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.neutron [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Releasing lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance network_info: |[{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] Acquired lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Start _get_guest_xml network_info=[{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:16:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-893880233',display_name='tempest-ServerStableDeviceRescueTest-server-893880233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-893880233',id=26,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvjm3mfZ3A1nuCZmbZ6DHT/v2SGbBbRTQ3rTSIMUmz2mJmOvLPnIXv0X38Y8d6CK5rqaKiD1dGcVRZtgMtuEvRpU8NWVcWg1sDGBjTB9suOOCGfZl5rX+FZPbfuqYw4Mw==',key_name='tempest-keypair-1355669994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49a5377fc1334955bebb27aeeecdcdff',ramdisk_id='',reservation_id='r-d424vfs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-686352298',owner_user_name='tempest-ServerStableDeviceRescueTest-686352298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7197d75a463840b38c24f31bda6b5ea2',uuid=ddc1e1f7-468c-411d-8406-4f22bf7b457b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converting VIF {"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:16:10 user nova-compute[75255]:   <uuid>ddc1e1f7-468c-411d-8406-4f22bf7b457b</uuid>
Nov 14 11:16:10 user nova-compute[75255]:   <name>instance-0000001a</name>
Nov 14 11:16:10 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:16:10 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:16:10 user nova-compute[75255]:   <metadata>
Nov 14 11:16:10 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:16:10 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:16:10 user nova-compute[75255]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-893880233</nova:name>
Nov 14 11:16:10 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:16:10</nova:creationTime>
Nov 14 11:16:10 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:16:10 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:16:10 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:16:10 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:16:10 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:16:10 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:16:10 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:16:10 user nova-compute[75255]:       <nova:owner>
Nov 14 11:16:10 user nova-compute[75255]:         <nova:user uuid="7197d75a463840b38c24f31bda6b5ea2">tempest-ServerStableDeviceRescueTest-686352298-project-member</nova:user>
Nov 14 11:16:10 user nova-compute[75255]:         <nova:project uuid="49a5377fc1334955bebb27aeeecdcdff">tempest-ServerStableDeviceRescueTest-686352298</nova:project>
Nov 14 11:16:10 user nova-compute[75255]:       </nova:owner>
Nov 14 11:16:10 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:16:10 user nova-compute[75255]:       <nova:ports>
Nov 14 11:16:10 user nova-compute[75255]:         <nova:port uuid="7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3">
Nov 14 11:16:10 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:16:10 user nova-compute[75255]:         </nova:port>
Nov 14 11:16:10 user nova-compute[75255]:       </nova:ports>
Nov 14 11:16:10 user nova-compute[75255]:     </nova:instance>
Nov 14 11:16:10 user nova-compute[75255]:   </metadata>
Nov 14 11:16:10 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:16:10 user nova-compute[75255]:     <system>
Nov 14 11:16:10 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:16:10 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:16:10 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:16:10 user nova-compute[75255]:       <entry name="serial">ddc1e1f7-468c-411d-8406-4f22bf7b457b</entry>
Nov 14 11:16:10 user nova-compute[75255]:       <entry name="uuid">ddc1e1f7-468c-411d-8406-4f22bf7b457b</entry>
Nov 14 11:16:10 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:16:10 user nova-compute[75255]:     </system>
Nov 14 11:16:10 user nova-compute[75255]:   </sysinfo>
Nov 14 11:16:10 user nova-compute[75255]:   <os>
Nov 14 11:16:10 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:16:10 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:16:10 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:16:10 user nova-compute[75255]:   </os>
Nov 14 11:16:10 user nova-compute[75255]:   <features>
Nov 14 11:16:10 user nova-compute[75255]:     <acpi/>
Nov 14 11:16:10 user nova-compute[75255]:     <apic/>
Nov 14 11:16:10 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:16:10 user nova-compute[75255]:   </features>
Nov 14 11:16:10 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:16:10 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:16:10 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:16:10 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:16:10 user nova-compute[75255]:   </clock>
Nov 14 11:16:10 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:16:10 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:16:10 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:16:10 user nova-compute[75255]:   </cpu>
Nov 14 11:16:10 user nova-compute[75255]:   <devices>
Nov 14 11:16:10 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:16:10 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:16:10 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk"/>
Nov 14 11:16:10 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:16:10 user nova-compute[75255]:     </disk>
Nov 14 11:16:10 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:16:10 user nova-compute[75255]:       <mac address="fa:16:3e:d0:5f:5a"/>
Nov 14 11:16:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:10 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:16:10 user nova-compute[75255]:       <target dev="tap7ff2a1b6-c7"/>
Nov 14 11:16:10 user nova-compute[75255]:     </interface>
Nov 14 11:16:10 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:16:10 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/console.log" append="off"/>
Nov 14 11:16:10 user nova-compute[75255]:     </serial>
Nov 14 11:16:10 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:16:10 user nova-compute[75255]:     <video>
Nov 14 11:16:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:10 user nova-compute[75255]:     </video>
Nov 14 11:16:10 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:16:10 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:16:10 user nova-compute[75255]:     </rng>
Nov 14 11:16:10 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:16:10 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:16:10 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:16:10 user nova-compute[75255]:     </memballoon>
Nov 14 11:16:10 user nova-compute[75255]:   </devices>
Nov 14 11:16:10 user nova-compute[75255]: </domain>
Nov 14 11:16:10 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-893880233',display_name='tempest-ServerStableDeviceRescueTest-server-893880233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-893880233',id=26,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvjm3mfZ3A1nuCZmbZ6DHT/v2SGbBbRTQ3rTSIMUmz2mJmOvLPnIXv0X38Y8d6CK5rqaKiD1dGcVRZtgMtuEvRpU8NWVcWg1sDGBjTB9suOOCGfZl5rX+FZPbfuqYw4Mw==',key_name='tempest-keypair-1355669994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49a5377fc1334955bebb27aeeecdcdff',ramdisk_id='',reservation_id='r-d424vfs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-686352298',owner_user_name='tempest-ServerStableDeviceRescueTest-686352298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7197d75a463840b38c24f31bda6b5ea2',uuid=ddc1e1f7-468c-411d-8406-4f22bf7b457b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converting VIF {"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG os_vif [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f2c5865-5eb3-5e81-a107-cfd7f009d40c', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ff2a1b6-c7, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ff2a1b6-c7, col_values=(('qos', UUID('fee3d465-4d04-426f-9a1b-ce378de3aae1')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ff2a1b6-c7, col_values=(('external_ids', {'iface-id': '7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:5f:5a', 'vm-uuid': 'ddc1e1f7-468c-411d-8406-4f22bf7b457b'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:10 user nova-compute[75255]: INFO os_vif [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7')
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No VIF found with MAC fa:16:3e:d0:5f:5a, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updated VIF entry in instance network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-673ab426-07f4-41c7-93d4-c5ddeef4bbe5 req-76167c82-8346-4aca-a12a-9f274fcc62f0 service nova] Releasing lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-5bec88db-e86a-40ca-94bd-854a02d99005 req-e2e1c6b3-6095-436c-ae43-fe3fd6ee8f11 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5bec88db-e86a-40ca-94bd-854a02d99005 req-e2e1c6b3-6095-436c-ae43-fe3fd6ee8f11 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5bec88db-e86a-40ca-94bd-854a02d99005 req-e2e1c6b3-6095-436c-ae43-fe3fd6ee8f11 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5bec88db-e86a-40ca-94bd-854a02d99005 req-e2e1c6b3-6095-436c-ae43-fe3fd6ee8f11 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-5bec88db-e86a-40ca-94bd-854a02d99005 req-e2e1c6b3-6095-436c-ae43-fe3fd6ee8f11 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:12 user nova-compute[75255]: WARNING nova.compute.manager [req-5bec88db-e86a-40ca-94bd-854a02d99005 req-e2e1c6b3-6095-436c-ae43-fe3fd6ee8f11 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state building and task_state spawning.
Nov 14 11:16:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:16:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance spawned successfully.
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:16:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:16:14 user nova-compute[75255]: INFO nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 14 11:16:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:16:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b38611ad-96a7-415f-8a4f-e2c6a008f7d6 req-fcd5ab32-06ca-47d9-84b1-106b19e6215a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b38611ad-96a7-415f-8a4f-e2c6a008f7d6 req-fcd5ab32-06ca-47d9-84b1-106b19e6215a service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b38611ad-96a7-415f-8a4f-e2c6a008f7d6 req-fcd5ab32-06ca-47d9-84b1-106b19e6215a service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b38611ad-96a7-415f-8a4f-e2c6a008f7d6 req-fcd5ab32-06ca-47d9-84b1-106b19e6215a service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-b38611ad-96a7-415f-8a4f-e2c6a008f7d6 req-fcd5ab32-06ca-47d9-84b1-106b19e6215a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:14 user nova-compute[75255]: WARNING nova.compute.manager [req-b38611ad-96a7-415f-8a4f-e2c6a008f7d6 req-fcd5ab32-06ca-47d9-84b1-106b19e6215a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state building and task_state spawning.
Nov 14 11:16:14 user nova-compute[75255]: INFO nova.compute.manager [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Took 6.34 seconds to build instance.
Nov 14 11:16:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-103af53e-2220-415c-b9bd-414a475fa24e tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.469s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:21 user nova-compute[75255]: INFO nova.compute.manager [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Rescuing
Nov 14 11:16:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG nova.network.neutron [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-5c746c37-39a7-4bed-bcc2-98b2cdb4e223 req-2b13e5d6-0615-4c9a-b600-ab26331b7f63 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5c746c37-39a7-4bed-bcc2-98b2cdb4e223 req-2b13e5d6-0615-4c9a-b600-ab26331b7f63 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5c746c37-39a7-4bed-bcc2-98b2cdb4e223 req-2b13e5d6-0615-4c9a-b600-ab26331b7f63 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5c746c37-39a7-4bed-bcc2-98b2cdb4e223 req-2b13e5d6-0615-4c9a-b600-ab26331b7f63 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-5c746c37-39a7-4bed-bcc2-98b2cdb4e223 req-2b13e5d6-0615-4c9a-b600-ab26331b7f63 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:22 user nova-compute[75255]: WARNING nova.compute.manager [req-5c746c37-39a7-4bed-bcc2-98b2cdb4e223 req-2b13e5d6-0615-4c9a-b600-ab26331b7f63 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance destroyed successfully.
Nov 14 11:16:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Attempting a stable device rescue
Nov 14 11:16:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75255) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:16:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Creating image(s)
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "/opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG nova.objects.instance [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'trusted_certs' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "f74b7191827caf7e9d39f764aaf5590147a50de1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "f74b7191827caf7e9d39f764aaf5590147a50de1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.part --force-share --output=json" returned: 0 in 0.260s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.images [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] 4ede5618-0a8f-48f1-836a-bb95d21cc926 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.part /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.part /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.converted" returned: 0 in 0.253s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-21e64bb5-8840-40cb-b298-c7b98ae798f4 req-c6248e3a-3b93-4462-81dc-de97f7d715ba service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-21e64bb5-8840-40cb-b298-c7b98ae798f4 req-c6248e3a-3b93-4462-81dc-de97f7d715ba service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-21e64bb5-8840-40cb-b298-c7b98ae798f4 req-c6248e3a-3b93-4462-81dc-de97f7d715ba service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-21e64bb5-8840-40cb-b298-c7b98ae798f4 req-c6248e3a-3b93-4462-81dc-de97f7d715ba service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-21e64bb5-8840-40cb-b298-c7b98ae798f4 req-c6248e3a-3b93-4462-81dc-de97f7d715ba service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:24 user nova-compute[75255]: WARNING nova.compute.manager [req-21e64bb5-8840-40cb-b298-c7b98ae798f4 req-c6248e3a-3b93-4462-81dc-de97f7d715ba service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "f74b7191827caf7e9d39f764aaf5590147a50de1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.728s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "f74b7191827caf7e9d39f764aaf5590147a50de1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "f74b7191827caf7e9d39f764aaf5590147a50de1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1,backing_fmt=raw /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1,backing_fmt=raw /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue" returned: 0 in 0.047s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "f74b7191827caf7e9d39f764aaf5590147a50de1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'migration_context' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<427d469e-db0a-48ef-bbed-92e8d7ad61fe> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Start _get_guest_xml network_info=[{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "vif_mac": "fa:16:3e:bb:d8:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4ede5618-0a8f-48f1-836a-bb95d21cc926', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '1731aa16-72ba-4f9c-b6e0-356d16929d5a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqhYfzRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '427d469e-db0a-48ef-bbed-92e8d7ad61fe', 'attached_at': '', 'detached_at': '', 'volume_id': '59544be6-2339-4966-a957-b0f9dc8c60bd', 'serial': '59544be6-2339-4966-a957-b0f9dc8c60bd'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'resources' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<427d469e-db0a-48ef-bbed-92e8d7ad61fe> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'numa_topology' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<427d469e-db0a-48ef-bbed-92e8d7ad61fe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:24 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:24 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'vcpu_model' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.objects.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<427d469e-db0a-48ef-bbed-92e8d7ad61fe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqhYfzRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:16:24 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:16:24 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:16:24 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b40db42-0838-45c5-99a3-608d0070ba32]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NqhYfzRu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 11:16:24 user nova-compute[75255]: node.name = iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:16:24 user nova-compute[75255]: node.tpgt = -1
Nov 14 11:16:24 user nova-compute[75255]: node.startup = automatic
Nov 14 11:16:24 user nova-compute[75255]: node.leading_login = No
Nov 14 11:16:24 user nova-compute[75255]: iface.iscsi_ifacename = default
Nov 14 11:16:24 user nova-compute[75255]: iface.net_ifacename = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.ipaddress = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.prefix_len = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.hwaddress = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.transport_name = tcp
Nov 14 11:16:24 user nova-compute[75255]: iface.initiatorname = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.state = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.vlan_id = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.vlan_priority = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.vlan_state = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.iface_num = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.mtu = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.port = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.bootproto = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.subnet_mask = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.gateway = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_alt_client_id = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_dns = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_learn_iqn = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_vendor_id_state = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_vendor_id = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.dhcp_slp_da = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.fragmentation = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.gratuitous_arp = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.incoming_forwarding = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.tos_state = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.tos = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.ttl = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.delayed_ack = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.tcp_nagle = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.tcp_wsf_state = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.tcp_wsf = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.tcp_timer_scale = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.tcp_timestamp = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.redirect = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.def_task_mgmt_timeout = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.header_digest = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.data_digest = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.immediate_data = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.initial_r2t = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.data_seq_inorder = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.data_pdu_inorder = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.erl = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.max_receive_data_len = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.first_burst_len = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.max_outstanding_r2t = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.max_burst_len = 0
Nov 14 11:16:24 user nova-compute[75255]: iface.chap_auth = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.bidi_chap = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.strict_login_compliance = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.discovery_auth = <empty>
Nov 14 11:16:24 user nova-compute[75255]: iface.discovery_logout = <empty>
Nov 14 11:16:24 user nova-compute[75255]: node.discovery_address = <empty>
Nov 14 11:16:24 user nova-compute[75255]: node.discovery_port = 0
Nov 14 11:16:24 user nova-compute[75255]: node.discovery_type = static
Nov 14 11:16:24 user nova-compute[75255]: node.session.initial_cmdsn = 0
Nov 14 11:16:24 user nova-compute[75255]: node.session.initial_login_retry_max = 8
Nov 14 11:16:24 user nova-compute[75255]: node.session.xmit_thread_priority = -20
Nov 14 11:16:24 user nova-compute[75255]: node.session.cmds_max = 128
Nov 14 11:16:24 user nova-compute[75255]: node.session.queue_depth = 32
Nov 14 11:16:24 user nova-compute[75255]: node.session.nr_sessions = 1
Nov 14 11:16:24 user nova-compute[75255]: node.session.auth.authmethod = CHAP
Nov 14 11:16:24 user nova-compute[75255]: node.session.auth.username = NqhYfzRu
Nov 14 11:16:24 user nova-compute[75255]: node.session.auth.password = ***
Nov 14 11:16:24 user nova-compute[75255]: node.session.auth.username_in = <empty>
Nov 14 11:16:24 user nova-compute[75255]: node.session.auth.password_in = <empty>
Nov 14 11:16:24 user nova-compute[75255]: node.session.auth.chap_algs = MD5
Nov 14 11:16:24 user nova-compute[75255]: node.session.timeo.replacement_timeout = 120
Nov 14 11:16:24 user nova-compute[75255]: node.session.err_timeo.abort_timeout = 15
Nov 14 11:16:24 user nova-compute[75255]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 11:16:24 user nova-compute[75255]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 11:16:24 user nova-compute[75255]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.FastAbort = Yes
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.InitialR2T = No
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.ImmediateData = Yes
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.MaxConnections = 1
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 11:16:24 user nova-compute[75255]: node.session.iscsi.ERL = 0
Nov 14 11:16:24 user nova-compute[75255]: node.session.scan = manual
Nov 14 11:16:24 user nova-compute[75255]: node.session.reopen_max = 0
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].address = 172.16.0.220
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].port = 3260
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].startup = manual
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].tcp.window_size = 524288
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].tcp.type_of_service = 0
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].timeo.logout_timeout = 15
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].timeo.login_timeout = 15
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].timeo.auth_timeout = 45
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].iscsi.DataDigest = None
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].iscsi.IFMarker = No
Nov 14 11:16:24 user nova-compute[75255]: node.conn[0].iscsi.OFMarker = No
Nov 14 11:16:24 user nova-compute[75255]: # END RECORD
Nov 14 11:16:24 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167e86b-d2e8-4047-a227-2d32f5bea215]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[528048d1-786f-4191-b2d3-ce5f6e5fdf62]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqhYfzRu {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqhYfzRu" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[47299c02-1169-4068-9a28-f765e74a8f3b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqhYfzRu'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be6dd9b-c281-4700-a5b4-892bbe5d4045]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd900848-3466-4f7c-be5f-a435a75db6f4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:16:24 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:16:24 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:16:24 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:16:24 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] HCTL ('35', '0', '0', 0) found on session 25 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:16:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a7da1-f96a-4099-a30b-41a0cdd36ce7]: (4, ('0 0 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching for a device in session 25 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqhYfzRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23131623531366465', 'path': '/dev/sdd'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131623531366465', 'path': '/dev/sdd'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1426869663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1426869663',id=22,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:14:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-h01gegs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:14:49Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=427d469e-db0a-48ef-bbed-92e8d7ad61fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "vif_mac": "fa:16:3e:bb:d8:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "vif_mac": "fa:16:3e:bb:d8:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.objects.instance [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'pci_devices' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.objects.base [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<427d469e-db0a-48ef-bbed-92e8d7ad61fe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:16:25 user nova-compute[75255]:   <uuid>427d469e-db0a-48ef-bbed-92e8d7ad61fe</uuid>
Nov 14 11:16:25 user nova-compute[75255]:   <name>instance-00000016</name>
Nov 14 11:16:25 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:16:25 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:16:25 user nova-compute[75255]:   <metadata>
Nov 14 11:16:25 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:16:25 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:16:25 user nova-compute[75255]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1426869663</nova:name>
Nov 14 11:16:25 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:16:24</nova:creationTime>
Nov 14 11:16:25 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:16:25 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:16:25 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:16:25 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:16:25 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:16:25 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:16:25 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:16:25 user nova-compute[75255]:       <nova:owner>
Nov 14 11:16:25 user nova-compute[75255]:         <nova:user uuid="3b82af4602b649889188f0f943c63896">tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member</nova:user>
Nov 14 11:16:25 user nova-compute[75255]:         <nova:project uuid="bbb07eaf3ea24939aeef6eba1bb2293d">tempest-ServerBootFromVolumeStableRescueTest-1912178200</nova:project>
Nov 14 11:16:25 user nova-compute[75255]:       </nova:owner>
Nov 14 11:16:25 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:16:25 user nova-compute[75255]:       <nova:ports>
Nov 14 11:16:25 user nova-compute[75255]:         <nova:port uuid="6c7285d5-c7d6-4ad4-8d39-7428e2068659">
Nov 14 11:16:25 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:16:25 user nova-compute[75255]:         </nova:port>
Nov 14 11:16:25 user nova-compute[75255]:       </nova:ports>
Nov 14 11:16:25 user nova-compute[75255]:     </nova:instance>
Nov 14 11:16:25 user nova-compute[75255]:   </metadata>
Nov 14 11:16:25 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:16:25 user nova-compute[75255]:     <system>
Nov 14 11:16:25 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:16:25 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:16:25 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:16:25 user nova-compute[75255]:       <entry name="serial">427d469e-db0a-48ef-bbed-92e8d7ad61fe</entry>
Nov 14 11:16:25 user nova-compute[75255]:       <entry name="uuid">427d469e-db0a-48ef-bbed-92e8d7ad61fe</entry>
Nov 14 11:16:25 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:16:25 user nova-compute[75255]:     </system>
Nov 14 11:16:25 user nova-compute[75255]:   </sysinfo>
Nov 14 11:16:25 user nova-compute[75255]:   <os>
Nov 14 11:16:25 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:16:25 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:16:25 user nova-compute[75255]:   </os>
Nov 14 11:16:25 user nova-compute[75255]:   <features>
Nov 14 11:16:25 user nova-compute[75255]:     <acpi/>
Nov 14 11:16:25 user nova-compute[75255]:     <apic/>
Nov 14 11:16:25 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:16:25 user nova-compute[75255]:   </features>
Nov 14 11:16:25 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:16:25 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:16:25 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:16:25 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:16:25 user nova-compute[75255]:   </clock>
Nov 14 11:16:25 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:16:25 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:16:25 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:16:25 user nova-compute[75255]:   </cpu>
Nov 14 11:16:25 user nova-compute[75255]:   <devices>
Nov 14 11:16:25 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:16:25 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:16:25 user nova-compute[75255]:       <source dev="/dev/sdd"/>
Nov 14 11:16:25 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:16:25 user nova-compute[75255]:       <serial>59544be6-2339-4966-a957-b0f9dc8c60bd</serial>
Nov 14 11:16:25 user nova-compute[75255]:     </disk>
Nov 14 11:16:25 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:16:25 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:16:25 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue"/>
Nov 14 11:16:25 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:16:25 user nova-compute[75255]:       <boot order="1"/>
Nov 14 11:16:25 user nova-compute[75255]:     </disk>
Nov 14 11:16:25 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:16:25 user nova-compute[75255]:       <mac address="fa:16:3e:bb:d8:f7"/>
Nov 14 11:16:25 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:25 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:16:25 user nova-compute[75255]:       <target dev="tap6c7285d5-c7"/>
Nov 14 11:16:25 user nova-compute[75255]:     </interface>
Nov 14 11:16:25 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:16:25 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/console.log" append="off"/>
Nov 14 11:16:25 user nova-compute[75255]:     </serial>
Nov 14 11:16:25 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:16:25 user nova-compute[75255]:     <video>
Nov 14 11:16:25 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:25 user nova-compute[75255]:     </video>
Nov 14 11:16:25 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:16:25 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:16:25 user nova-compute[75255]:     </rng>
Nov 14 11:16:25 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:16:25 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:16:25 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:16:25 user nova-compute[75255]:     </memballoon>
Nov 14 11:16:25 user nova-compute[75255]:   </devices>
Nov 14 11:16:25 user nova-compute[75255]: </domain>
Nov 14 11:16:25 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:16:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance destroyed successfully.
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No VIF found with MAC fa:16:3e:bb:d8:f7, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:16:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-81e55b5e-bf54-459e-b6ce-962e353c29b7 req-3e1fb06c-1890-412f-9e58-c951ca0cd2e7 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-81e55b5e-bf54-459e-b6ce-962e353c29b7 req-3e1fb06c-1890-412f-9e58-c951ca0cd2e7 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-81e55b5e-bf54-459e-b6ce-962e353c29b7 req-3e1fb06c-1890-412f-9e58-c951ca0cd2e7 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-81e55b5e-bf54-459e-b6ce-962e353c29b7 req-3e1fb06c-1890-412f-9e58-c951ca0cd2e7 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-81e55b5e-bf54-459e-b6ce-962e353c29b7 req-3e1fb06c-1890-412f-9e58-c951ca0cd2e7 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:26 user nova-compute[75255]: WARNING nova.compute.manager [req-81e55b5e-bf54-459e-b6ce-962e353c29b7 req-3e1fb06c-1890-412f-9e58-c951ca0cd2e7 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-966af60e-df27-4f9e-b519-37897587b3f4 req-adafaf95-cdaa-4cd8-b091-d84564457478 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-966af60e-df27-4f9e-b519-37897587b3f4 req-adafaf95-cdaa-4cd8-b091-d84564457478 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-966af60e-df27-4f9e-b519-37897587b3f4 req-adafaf95-cdaa-4cd8-b091-d84564457478 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-966af60e-df27-4f9e-b519-37897587b3f4 req-adafaf95-cdaa-4cd8-b091-d84564457478 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-966af60e-df27-4f9e-b519-37897587b3f4 req-adafaf95-cdaa-4cd8-b091-d84564457478 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:28 user nova-compute[75255]: WARNING nova.compute.manager [req-966af60e-df27-4f9e-b519-37897587b3f4 req-adafaf95-cdaa-4cd8-b091-d84564457478 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-122435ae-416f-433b-b06a-7f911625c71b tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:16:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:30 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7596MB free_disk=25.115924835205078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9057f65e-8951-49ad-963c-a62d9a8a1724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:16:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:41 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:16:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:16:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing instance network info cache due to event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] Acquiring lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] Acquired lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG nova.network.neutron [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'flavor' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:45 user nova-compute[75255]: INFO nova.compute.manager [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Attaching volume 9770a256-2a45-4add-af00-515ef19818a3 to /dev/vdb
Nov 14 11:16:45 user nova-compute[75255]: DEBUG os_brick.utils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c0db6e-8c29-43ae-be55-d76dc33548e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bf57a2-b893-4ed0-ad2a-1bf4607f161a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679464f-b31c-4779-a143-dd55baeefcd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[237de36e-54da-4eb5-8fc5-d6cb3a8559a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG nova.network.neutron [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updated VIF entry in instance network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG nova.network.neutron [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:16:46 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:16:46 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0019b83-cd78-47c3-9b72-69c541f8b781]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG os_brick.utils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating existing volume attachment record: f6d09967-8f9a-4b26-bd7c-0f805ffcbfc2 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:16:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e9571033-d068-41c7-9e34-9d60f41f1109 req-e4c5f21e-bb6d-4dcd-a7fc-b7d0608a34ef service nova] Releasing lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhRqgtBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:16:50 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:16:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:16:50 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:16:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:16:50 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:16:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae1d059-5190-4a84-90ab-c3f34343407d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:16:50 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca90eb7a-5762-4fe3-9843-1ca709121245]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3] added
Nov 14 11:16:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.225s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233b88a-304b-4cf1-bd4e-b7727a221458]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c970c4e7-bad1-4354-8462-9239cbe4c104]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhRqgtBA {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhRqgtBA" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef35cb-bf08-4196-9ca0-3fed27f70cbf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LhRqgtBA'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ada2c36-a1fb-4817-a4bf-5d21425417f4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[14417c98-8ef6-41c8-ad1e-df8735b37a1d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:16:51 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:16:51 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:16:51 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:16:51 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9592b0bd-9db2-44a9-a8ad-d9ca8b6da754]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260]
Nov 14 11:16:51 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260] successful.
Nov 14 11:16:51 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ecadc5-81b4-4fc3-9091-dae14bf97d58]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ec1876-1dff-44fe-b5d2-b3017a0a3eca]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:16:51 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:16:51 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:16:51 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:16:51 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:16:51 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:16:51 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.556s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9483ac6d-bc4b-4700-8f70-43edd33a8281]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:16:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhRqgtBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.594s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] <== connect_volume: return (1596ms) {'type': 'block', 'scsi_wwn': '23734313832646664', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734313832646664', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'flavor' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:16:52 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:16:52 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:16:52 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:16:52 user nova-compute[75255]:   <serial>9770a256-2a45-4add-af00-515ef19818a3</serial>
Nov 14 11:16:52 user nova-compute[75255]: </disk>
Nov 14 11:16:52 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:16:52 user nova-compute[75255]: INFO nova.compute.claims [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Claim successful on node user
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No VIF found with MAC fa:16:3e:6b:25:a0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d156d7e7-b59b-4a95-9671-190cc983c012 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.102s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.policy [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501c5fe846ca4bfeacc413c97911f8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524a841af9524bd98f64657594598808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.compute.manager [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Terminating instance
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Creating image(s)
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "/opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "/opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.196s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-0fd8141e-f89b-4be9-80e3-751e397c197f req-3e006b89-c7a7-4ed8-bc1d-0b2e80174922 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received event network-vif-unplugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0fd8141e-f89b-4be9-80e3-751e397c197f req-3e006b89-c7a7-4ed8-bc1d-0b2e80174922 service nova] Acquiring lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0fd8141e-f89b-4be9-80e3-751e397c197f req-3e006b89-c7a7-4ed8-bc1d-0b2e80174922 service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0fd8141e-f89b-4be9-80e3-751e397c197f req-3e006b89-c7a7-4ed8-bc1d-0b2e80174922 service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-0fd8141e-f89b-4be9-80e3-751e397c197f req-3e006b89-c7a7-4ed8-bc1d-0b2e80174922 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] No waiting events found dispatching network-vif-unplugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-0fd8141e-f89b-4be9-80e3-751e397c197f req-3e006b89-c7a7-4ed8-bc1d-0b2e80174922 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received event network-vif-unplugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk 1073741824" returned: 0 in 0.052s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.compute.manager [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Rescuing
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Instance destroyed successfully.
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lazy-loading 'resources' on Instance uuid 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-423940193',display_name='tempest-VolumesActionsTest-instance-423940193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-423940193',id=24,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='feb2db5b35b344b4a0f939695dda98ec',ramdisk_id='',reservation_id='r-qz0wbwy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1934295409',owner_user_name='tempest-VolumesActionsTest-1934295409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:15:10Z,user_data=None,user_id='51df3343a8524c14ac4788217825a99f',uuid=3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converting VIF {"id": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "address": "fa:16:3e:49:a1:8b", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c00153-04", "ovs_interfaceid": "52c00153-0443-4fdc-8252-fb0f04bae1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a1:8b,bridge_name='br-int',has_traffic_filtering=True,id=52c00153-0443-4fdc-8252-fb0f04bae1d2,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c00153-04') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG os_vif [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a1:8b,bridge_name='br-int',has_traffic_filtering=True,id=52c00153-0443-4fdc-8252-fb0f04bae1d2,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c00153-04') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52c00153-04, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=510b57d9-79c3-4d59-ba64-6f14da9f47fe) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:53 user nova-compute[75255]: INFO os_vif [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a1:8b,bridge_name='br-int',has_traffic_filtering=True,id=52c00153-0443-4fdc-8252-fb0f04bae1d2,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c00153-04')
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Deleting instance files /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a_del
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Deletion of /opt/stack/data/nova/instances/3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a_del complete
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:53 user nova-compute[75255]: INFO nova.compute.manager [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 14 11:16:53 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:16:53 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Cannot resize image /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Ensure instance console log exists: /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Successfully created port: aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-94702e26-da63-45cb-b91e-eed8df7d54b3 req-79e3f33c-f561-479e-b644-371682a954ae service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94702e26-da63-45cb-b91e-eed8df7d54b3 req-79e3f33c-f561-479e-b644-371682a954ae service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94702e26-da63-45cb-b91e-eed8df7d54b3 req-79e3f33c-f561-479e-b644-371682a954ae service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-94702e26-da63-45cb-b91e-eed8df7d54b3 req-79e3f33c-f561-479e-b644-371682a954ae service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-94702e26-da63-45cb-b91e-eed8df7d54b3 req-79e3f33c-f561-479e-b644-371682a954ae service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:55 user nova-compute[75255]: WARNING nova.compute.manager [req-94702e26-da63-45cb-b91e-eed8df7d54b3 req-79e3f33c-f561-479e-b644-371682a954ae service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Successfully updated port: aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquired lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:55 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Took 1.20 seconds to deallocate network for instance.
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance destroyed successfully.
Nov 14 11:16:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Attempting rescue
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75255) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:16:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Creating image(s)
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updating instance_info_cache with network_info: [{"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Releasing lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Instance network_info: |[{"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Start _get_guest_xml network_info=[{"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:16:55 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:55 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1394251709',display_name='tempest-AttachVolumeNegativeTest-server-1394251709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1394251709',id=27,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8m2JXsbQr01ZeLqju51q9SUJDLADovxJZoE81uReTfiF9LQfAdAzDhIGGiAIipIoWhJl37vC/lFu8Kz0RMQppWwwBh+IHzu7IHxn8wa6jPEw1Xy9+6THMteTj+iNtSzA==',key_name='tempest-keypair-2055220250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-n15disza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=69fe826e-b67c-4109-914d-94c04d09a216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:9d,bridge_name='br-int',has_traffic_filtering=True,id=aea1359b-9af0-4ab0-b694-533c76eaea02,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea1359b-9a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'pci_devices' on Instance uuid 69fe826e-b67c-4109-914d-94c04d09a216 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:16:55 user nova-compute[75255]:   <uuid>69fe826e-b67c-4109-914d-94c04d09a216</uuid>
Nov 14 11:16:55 user nova-compute[75255]:   <name>instance-0000001b</name>
Nov 14 11:16:55 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:16:55 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:16:55 user nova-compute[75255]:   <metadata>
Nov 14 11:16:55 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:16:55 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1394251709</nova:name>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:16:55</nova:creationTime>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:16:55 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:16:55 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:owner>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:user uuid="501c5fe846ca4bfeacc413c97911f8f6">tempest-AttachVolumeNegativeTest-1930109654-project-member</nova:user>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:project uuid="524a841af9524bd98f64657594598808">tempest-AttachVolumeNegativeTest-1930109654</nova:project>
Nov 14 11:16:55 user nova-compute[75255]:       </nova:owner>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:ports>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:port uuid="aea1359b-9af0-4ab0-b694-533c76eaea02">
Nov 14 11:16:55 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:16:55 user nova-compute[75255]:         </nova:port>
Nov 14 11:16:55 user nova-compute[75255]:       </nova:ports>
Nov 14 11:16:55 user nova-compute[75255]:     </nova:instance>
Nov 14 11:16:55 user nova-compute[75255]:   </metadata>
Nov 14 11:16:55 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:16:55 user nova-compute[75255]:     <system>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="serial">69fe826e-b67c-4109-914d-94c04d09a216</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="uuid">69fe826e-b67c-4109-914d-94c04d09a216</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:16:55 user nova-compute[75255]:     </system>
Nov 14 11:16:55 user nova-compute[75255]:   </sysinfo>
Nov 14 11:16:55 user nova-compute[75255]:   <os>
Nov 14 11:16:55 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:16:55 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:16:55 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:16:55 user nova-compute[75255]:   </os>
Nov 14 11:16:55 user nova-compute[75255]:   <features>
Nov 14 11:16:55 user nova-compute[75255]:     <acpi/>
Nov 14 11:16:55 user nova-compute[75255]:     <apic/>
Nov 14 11:16:55 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:16:55 user nova-compute[75255]:   </features>
Nov 14 11:16:55 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:16:55 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:16:55 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:16:55 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:16:55 user nova-compute[75255]:   </clock>
Nov 14 11:16:55 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:16:55 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:16:55 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:16:55 user nova-compute[75255]:   </cpu>
Nov 14 11:16:55 user nova-compute[75255]:   <devices>
Nov 14 11:16:55 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:16:55 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:16:55 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk"/>
Nov 14 11:16:55 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:16:55 user nova-compute[75255]:     </disk>
Nov 14 11:16:55 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:16:55 user nova-compute[75255]:       <mac address="fa:16:3e:7d:03:9d"/>
Nov 14 11:16:55 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:55 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:16:55 user nova-compute[75255]:       <target dev="tapaea1359b-9a"/>
Nov 14 11:16:55 user nova-compute[75255]:     </interface>
Nov 14 11:16:55 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:16:55 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/console.log" append="off"/>
Nov 14 11:16:55 user nova-compute[75255]:     </serial>
Nov 14 11:16:55 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:16:55 user nova-compute[75255]:     <video>
Nov 14 11:16:55 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:55 user nova-compute[75255]:     </video>
Nov 14 11:16:55 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:16:55 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:16:55 user nova-compute[75255]:     </rng>
Nov 14 11:16:55 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:16:55 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:16:55 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:16:55 user nova-compute[75255]:     </memballoon>
Nov 14 11:16:55 user nova-compute[75255]:   </devices>
Nov 14 11:16:55 user nova-compute[75255]: </domain>
Nov 14 11:16:55 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1394251709',display_name='tempest-AttachVolumeNegativeTest-server-1394251709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1394251709',id=27,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8m2JXsbQr01ZeLqju51q9SUJDLADovxJZoE81uReTfiF9LQfAdAzDhIGGiAIipIoWhJl37vC/lFu8Kz0RMQppWwwBh+IHzu7IHxn8wa6jPEw1Xy9+6THMteTj+iNtSzA==',key_name='tempest-keypair-2055220250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-n15disza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=69fe826e-b67c-4109-914d-94c04d09a216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:9d,bridge_name='br-int',has_traffic_filtering=True,id=aea1359b-9af0-4ab0-b694-533c76eaea02,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea1359b-9a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG os_vif [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:9d,bridge_name='br-int',has_traffic_filtering=True,id=aea1359b-9af0-4ab0-b694-533c76eaea02,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea1359b-9a') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '421cbdac-4fef-547f-aa4b-3f2652fa262e', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received event network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] Acquiring lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] No waiting events found dispatching network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:55 user nova-compute[75255]: WARNING nova.compute.manager [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received unexpected event network-vif-plugged-52c00153-0443-4fdc-8252-fb0f04bae1d2 for instance with vm_state deleted and task_state None.
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-changed-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Refreshing instance network info cache due to event network-changed-aea1359b-9af0-4ab0-b694-533c76eaea02. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] Acquiring lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] Acquired lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.neutron [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Refreshing network info cache for port aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue" returned: 0 in 0.072s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'migration_context' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaea1359b-9a, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaea1359b-9a, col_values=(('qos', UUID('750c1890-3f83-4c22-8eea-39bffe5fe4d3')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaea1359b-9a, col_values=(('external_ids', {'iface-id': 'aea1359b-9af0-4ab0-b694-533c76eaea02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:03:9d', 'vm-uuid': '69fe826e-b67c-4109-914d-94c04d09a216'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.base [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<7bae2ca8-f0e2-4b1c-8153-0836383dab5d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Start _get_guest_xml network_info=[{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:6b:25:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'resources' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.base [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<7bae2ca8-f0e2-4b1c-8153-0836383dab5d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'numa_topology' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:55 user nova-compute[75255]: INFO os_vif [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:9d,bridge_name='br-int',has_traffic_filtering=True,id=aea1359b-9af0-4ab0-b694-533c76eaea02,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea1359b-9a')
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.base [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<7bae2ca8-f0e2-4b1c-8153-0836383dab5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:55 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:55 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.base [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<7bae2ca8-f0e2-4b1c-8153-0836383dab5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-601843745',display_name='tempest-ServerRescueNegativeTestJSON-server-601843745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-601843745',id=23,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXbThBksLRb7OJ/ZqAWmSa7CpRhp6HVt9MtrWqjBQuNdICzPnlAUwWGwrQkljFKbWOMwvEByCdSwGK9oOQbw28XpMokcEie6HNS3TlH5BwHKRbIQm6fefmSlTyorBkkOQ==',key_name='tempest-keypair-527098458',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-3um6ny4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=7bae2ca8-f0e2-4b1c-8153-0836383dab5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:6b:25:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "vif_mac": "fa:16:3e:6b:25:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.objects.base [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Object Instance<7bae2ca8-f0e2-4b1c-8153-0836383dab5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:16:55 user nova-compute[75255]:   <uuid>7bae2ca8-f0e2-4b1c-8153-0836383dab5d</uuid>
Nov 14 11:16:55 user nova-compute[75255]:   <name>instance-00000017</name>
Nov 14 11:16:55 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:16:55 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:16:55 user nova-compute[75255]:   <metadata>
Nov 14 11:16:55 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:16:55 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-601843745</nova:name>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:16:55</nova:creationTime>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:16:55 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:16:55 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:owner>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:user uuid="13c7ed01376d41ac9b99ba698909e8bf">tempest-ServerRescueNegativeTestJSON-2135406154-project-member</nova:user>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:project uuid="e4a3c374e68a4ec483ff0a15298b1bff">tempest-ServerRescueNegativeTestJSON-2135406154</nova:project>
Nov 14 11:16:55 user nova-compute[75255]:       </nova:owner>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:16:55 user nova-compute[75255]:       <nova:ports>
Nov 14 11:16:55 user nova-compute[75255]:         <nova:port uuid="fc0b9ee4-f968-428a-be9c-48b6a5b83339">
Nov 14 11:16:55 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 11:16:55 user nova-compute[75255]:         </nova:port>
Nov 14 11:16:55 user nova-compute[75255]:       </nova:ports>
Nov 14 11:16:55 user nova-compute[75255]:     </nova:instance>
Nov 14 11:16:55 user nova-compute[75255]:   </metadata>
Nov 14 11:16:55 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:16:55 user nova-compute[75255]:     <system>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="serial">7bae2ca8-f0e2-4b1c-8153-0836383dab5d</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="uuid">7bae2ca8-f0e2-4b1c-8153-0836383dab5d</entry>
Nov 14 11:16:55 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:16:55 user nova-compute[75255]:     </system>
Nov 14 11:16:55 user nova-compute[75255]:   </sysinfo>
Nov 14 11:16:55 user nova-compute[75255]:   <os>
Nov 14 11:16:55 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:16:55 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:16:55 user nova-compute[75255]:   </os>
Nov 14 11:16:55 user nova-compute[75255]:   <features>
Nov 14 11:16:55 user nova-compute[75255]:     <acpi/>
Nov 14 11:16:55 user nova-compute[75255]:     <apic/>
Nov 14 11:16:55 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:16:55 user nova-compute[75255]:   </features>
Nov 14 11:16:55 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:16:55 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:16:55 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:16:55 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:16:55 user nova-compute[75255]:   </clock>
Nov 14 11:16:55 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:16:55 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:16:55 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:16:55 user nova-compute[75255]:   </cpu>
Nov 14 11:16:55 user nova-compute[75255]:   <devices>
Nov 14 11:16:55 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:16:55 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:16:55 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue"/>
Nov 14 11:16:55 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:16:55 user nova-compute[75255]:     </disk>
Nov 14 11:16:55 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:16:55 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:16:55 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk"/>
Nov 14 11:16:55 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:16:55 user nova-compute[75255]:     </disk>
Nov 14 11:16:55 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:16:55 user nova-compute[75255]:       <mac address="fa:16:3e:6b:25:a0"/>
Nov 14 11:16:55 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:55 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:16:55 user nova-compute[75255]:       <target dev="tapfc0b9ee4-f9"/>
Nov 14 11:16:55 user nova-compute[75255]:     </interface>
Nov 14 11:16:55 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:16:55 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/console.log" append="off"/>
Nov 14 11:16:55 user nova-compute[75255]:     </serial>
Nov 14 11:16:55 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:16:55 user nova-compute[75255]:     <video>
Nov 14 11:16:55 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:16:55 user nova-compute[75255]:     </video>
Nov 14 11:16:55 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:16:55 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:16:55 user nova-compute[75255]:     </rng>
Nov 14 11:16:55 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:16:55 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:16:55 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:16:55 user nova-compute[75255]:     </memballoon>
Nov 14 11:16:55 user nova-compute[75255]:   </devices>
Nov 14 11:16:55 user nova-compute[75255]: </domain>
Nov 14 11:16:55 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No VIF found with MAC fa:16:3e:7d:03:9d, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:16:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance destroyed successfully.
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:55 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Deleted allocations for instance 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] No VIF found with MAC fa:16:3e:6b:25:a0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:16:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7cf192d5-2a3d-4a72-a577-74f43ad2492b tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updated VIF entry in instance network info cache for port aea1359b-9af0-4ab0-b694-533c76eaea02. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:16:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updating instance_info_cache with network_info: [{"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:16:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-472107ba-7566-4a04-94dd-fe2f5662dfd3 req-446404b0-1d65-4c32-84d7-5d722611b20b service nova] Releasing lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:16:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-41207f5d-3f9b-4102-af60-45676ed12d03 req-582311f5-3aac-451b-9eec-567b50e91ab4 service nova] [instance: 3f49f346-2f7e-4ec9-a476-e90e0ac2ea9a] Received event network-vif-deleted-52c00153-0443-4fdc-8252-fb0f04bae1d2 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-41207f5d-3f9b-4102-af60-45676ed12d03 req-582311f5-3aac-451b-9eec-567b50e91ab4 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41207f5d-3f9b-4102-af60-45676ed12d03 req-582311f5-3aac-451b-9eec-567b50e91ab4 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41207f5d-3f9b-4102-af60-45676ed12d03 req-582311f5-3aac-451b-9eec-567b50e91ab4 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41207f5d-3f9b-4102-af60-45676ed12d03 req-582311f5-3aac-451b-9eec-567b50e91ab4 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-41207f5d-3f9b-4102-af60-45676ed12d03 req-582311f5-3aac-451b-9eec-567b50e91ab4 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:57 user nova-compute[75255]: WARNING nova.compute.manager [req-41207f5d-3f9b-4102-af60-45676ed12d03 req-582311f5-3aac-451b-9eec-567b50e91ab4 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:59 user nova-compute[75255]: WARNING nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received unexpected event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with vm_state building and task_state spawning.
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:59 user nova-compute[75255]: WARNING nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received unexpected event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with vm_state building and task_state spawning.
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:59 user nova-compute[75255]: WARNING nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:16:59 user nova-compute[75255]: DEBUG nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:16:59 user nova-compute[75255]: WARNING nova.compute.manager [req-11354d72-93d1-4c2f-bd55-3bd40a955b4a req-7335b2e6-f4fd-41d8-8f29-b9bf5fd92481 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state active and task_state rescuing.
Nov 14 11:16:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:17:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:17:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3cd757b4-f37a-4ff4-8ffb-b414e65fbf3d tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:17:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Instance spawned successfully.
Nov 14 11:17:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:17:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:01 user nova-compute[75255]: INFO nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Took 7.92 seconds to spawn the instance on the hypervisor.
Nov 14 11:17:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:17:01 user nova-compute[75255]: INFO nova.compute.manager [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Took 8.77 seconds to build instance.
Nov 14 11:17:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4a5cc2b4-51df-4fa3-8df7-8fffe82f17aa tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.872s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-changed-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Refreshing instance network info cache due to event network-changed-1aac53ad-ce4c-44b3-a42c-d947e908163a. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] Acquiring lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] Acquired lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Refreshing network info cache for port 1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'flavor' on Instance uuid 9057f65e-8951-49ad-963c-a62d9a8a1724 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:12 user nova-compute[75255]: INFO nova.compute.manager [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Attaching volume ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 to /dev/vdb
Nov 14 11:17:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updated VIF entry in instance network info cache for port 1aac53ad-ce4c-44b3-a42c-d947e908163a. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updating instance_info_cache with network_info: [{"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-757a3994-d58c-476c-81b1-48904d00529b req-49fcb8ba-2513-4dd4-8f85-f0d806455b4b service nova] Releasing lock "refresh_cache-9057f65e-8951-49ad-963c-a62d9a8a1724" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG os_brick.utils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b511f7-786e-4c21-96fc-7f736a56ab6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b451026-4778-44d0-a224-4e3055da24ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27adaf0-6465-4e68-aa99-7c22de4a42ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[091603b0-5543-40d5-8f79-2e979bb04bb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:17:12 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:17:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a687e4-4301-4624-820c-0f7238bf747e]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG os_brick.utils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:17:12 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updating existing volume attachment record: e795ce25-47b7-4c7b-a84d-e44ba2e0448e {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing instance network info cache due to event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updated VIF entry in instance network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:17:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f680b0a7-5e2c-4611-9c2f-6c01c6830eeb req-49dcc9c8-7f83-4bec-898c-1fe8da248e2d service nova] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing instance network info cache due to event network-changed-01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.network.neutron [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Refreshing network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:15 user nova-compute[75255]: INFO nova.compute.manager [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Detaching volume 41b41a48-88b1-4f91-b2e0-26f7454d5e81
Nov 14 11:17:15 user nova-compute[75255]: INFO nova.virt.block_device [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Attempting to driver detach volume 41b41a48-88b1-4f91-b2e0-26f7454d5e81 from mountpoint /dev/vdb
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Attempting to detach device vdb from instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:17:15 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:17:15 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:17:15 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:17:15 user nova-compute[75255]:   <serial>41b41a48-88b1-4f91-b2e0-26f7454d5e81</serial>
Nov 14 11:17:15 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:17:15 user nova-compute[75255]: </disk>
Nov 14 11:17:15 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:17:15 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully detached device vdb from instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 from the persistent domain config.
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:17:15 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:17:15 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:17:15 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:17:15 user nova-compute[75255]:   <serial>41b41a48-88b1-4f91-b2e0-26f7454d5e81</serial>
Nov 14 11:17:15 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:17:15 user nova-compute[75255]: </disk>
Nov 14 11:17:15 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.network.neutron [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updated VIF entry in instance network info cache for port 01fbf551-a2f6-4910-9b9a-c27a216c78c9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.network.neutron [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-56ac3dda-557e-4fe4-bcd5-e79e2d96e4c0 req-91417b7d-066e-4161-ac70-0387a3edd62b service nova] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:17:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:17:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:17:17 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf689bc-efc5-4349-8e95-2d8f98241846]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:17:17 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a41fe80-15c6-4c51-a1b4-d797a8e9b705]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3] added
Nov 14 11:17:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c2f9d-fee1-4b72-a2e4-0f60677a111b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7268b-ee67-451d-b221-1b14190d6825]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qKaZUXCO {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qKaZUXCO" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e3649-1d28-4284-8cd8-27198719ad78]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qKaZUXCO'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0c369-c9d3-4efa-a628-b6811d521d8e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b8e6c-ed13-48b7-a02d-224139b857a4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:17 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:17 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:17 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:17 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51def024-cb74-418b-8941-4c3d3ad3a07e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]
Nov 14 11:17:18 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.
Nov 14 11:17:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5520db19-0fb7-4f42-a7dc-479266da60a1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeb58c5-b228-402e-b579-266f3207b732]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:18 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:18 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:18 user nova-compute[75255]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:18 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:18 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:18 user nova-compute[75255]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0133ed05-9cbc-4b15-8490-7b327698318f]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:17:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23461626539356136', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461626539356136', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG nova.objects.instance [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'flavor' on Instance uuid 9057f65e-8951-49ad-963c-a62d9a8a1724 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:17:19 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:17:19 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:17:19 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:17:19 user nova-compute[75255]:   <serial>ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3</serial>
Nov 14 11:17:19 user nova-compute[75255]: </disk>
Nov 14 11:17:19 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No VIF found with MAC fa:16:3e:78:56:18, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:17:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-81e6b942-0d7c-4cb8-9330-690a052f2141 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.174s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:21 user nova-compute[75255]: INFO nova.compute.manager [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Rebuilding instance
Nov 14 11:17:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-1ab18920-3de3-48b7-bb69-8ea5f94c6305 req-bf0be617-9b6f-4acb-9ef9-47e9859d70c0 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-unplugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ab18920-3de3-48b7-bb69-8ea5f94c6305 req-bf0be617-9b6f-4acb-9ef9-47e9859d70c0 service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ab18920-3de3-48b7-bb69-8ea5f94c6305 req-bf0be617-9b6f-4acb-9ef9-47e9859d70c0 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ab18920-3de3-48b7-bb69-8ea5f94c6305 req-bf0be617-9b6f-4acb-9ef9-47e9859d70c0 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-1ab18920-3de3-48b7-bb69-8ea5f94c6305 req-bf0be617-9b6f-4acb-9ef9-47e9859d70c0 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-unplugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:17:21 user nova-compute[75255]: WARNING nova.compute.manager [req-1ab18920-3de3-48b7-bb69-8ea5f94c6305 req-bf0be617-9b6f-4acb-9ef9-47e9859d70c0 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received unexpected event network-vif-unplugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with vm_state active and task_state rebuilding.
Nov 14 11:17:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance destroyed successfully.
Nov 14 11:17:22 user nova-compute[75255]: INFO nova.compute.manager [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Detaching volume ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3
Nov 14 11:17:22 user nova-compute[75255]: INFO nova.virt.block_device [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Attempting to driver detach volume ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 from mountpoint /dev/vdb
Nov 14 11:17:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Attempting to detach device vdb from instance 9057f65e-8951-49ad-963c-a62d9a8a1724 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:17:22 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:17:22 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:17:22 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:17:22 user nova-compute[75255]:   <serial>ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3</serial>
Nov 14 11:17:22 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:17:22 user nova-compute[75255]: </disk>
Nov 14 11:17:22 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:17:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully detached device vdb from instance 9057f65e-8951-49ad-963c-a62d9a8a1724 from the persistent domain config.
Nov 14 11:17:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:17:22 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cca902-25b2-41e5-a679-8ff06ce675c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:17:22 user nova-compute[75255]: No targets found.
Nov 14 11:17:22 user nova-compute[75255]: iSNS:
Nov 14 11:17:22 user nova-compute[75255]: No targets found.
Nov 14 11:17:22 user nova-compute[75255]: STATIC:
Nov 14 11:17:22 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3
Nov 14 11:17:22 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:22 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:22 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3
Nov 14 11:17:22 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:22 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:22 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81
Nov 14 11:17:22 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:22 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:22 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:17:22 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:22 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:22 user nova-compute[75255]: FIRMWARE:
Nov 14 11:17:22 user nova-compute[75255]: No targets found.
Nov 14 11:17:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:17:22 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:17:22 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee68fd-4b68-400a-9114-f9bae784de6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[203475d8-032a-49ea-8eaa-2e23a45765fe]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:22 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:22 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:22 user nova-compute[75255]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:22 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:22 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:22 user nova-compute[75255]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281de9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8668c420-9037-42c7-be36-63e128d8644e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bfe040-cfe6-45dd-bdbd-8d3ecd03ea2e]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e9a0c-ab4c-4f49-833d-301dab91b0ec]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6610add4-8d7a-4fff-968b-41fa0c6ecf9a]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6649fa5-7e63-4449-801a-36c11e5fc868]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba49f0a-4676-46f5-bfd3-406141bff361]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]
Nov 14 11:17:22 user nova-compute[75255]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.
Nov 14 11:17:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac47198-de47-4783-8b3b-1d220f4d33a7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== disconnect_volume: return (308ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:17:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:17:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance destroyed successfully.
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1601762684',display_name='tempest-ServerActionsTestOtherA-server-15543675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1601762684',id=25,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhcx8OgnnF0sgX7lf5Bb/Ju9ZNs5VH3jSw48Yyf9PzYERs0enurSVnV4ZbPhgypn+lr+5fCW5y+08OCGzhvWHfPpd7bjdumzk5JuaEuMh4lWf12uun4pcHA18MdN3akUA==',key_name='tempest-keypair-1173659248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-33uqdt3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:17:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=9057f65e-8951-49ad-963c-a62d9a8a1724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_vif [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aac53ad-ce, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0334de96-10d9-4e7d-a8c7-054fcfe8caf2) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:23 user nova-compute[75255]: INFO os_vif [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce')
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:17:23 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e600c9-d670-41f3-ad2f-f23f492c0f0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:17:23 user nova-compute[75255]: No targets found.
Nov 14 11:17:23 user nova-compute[75255]: iSNS:
Nov 14 11:17:23 user nova-compute[75255]: No targets found.
Nov 14 11:17:23 user nova-compute[75255]: STATIC:
Nov 14 11:17:23 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3
Nov 14 11:17:23 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:23 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:23 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81
Nov 14 11:17:23 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:23 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:23 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:17:23 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:23 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:23 user nova-compute[75255]: FIRMWARE:
Nov 14 11:17:23 user nova-compute[75255]: No targets found.
Nov 14 11:17:23 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:17:23 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:17:23 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-83be5844-8494-44ad-929e-ef76aa51b87a req-5d4babda-7e2e-473b-9a26-ece5a4ec454d service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-83be5844-8494-44ad-929e-ef76aa51b87a req-5d4babda-7e2e-473b-9a26-ece5a4ec454d service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-83be5844-8494-44ad-929e-ef76aa51b87a req-5d4babda-7e2e-473b-9a26-ece5a4ec454d service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-83be5844-8494-44ad-929e-ef76aa51b87a req-5d4babda-7e2e-473b-9a26-ece5a4ec454d service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-83be5844-8494-44ad-929e-ef76aa51b87a req-5d4babda-7e2e-473b-9a26-ece5a4ec454d service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:17:23 user nova-compute[75255]: WARNING nova.compute.manager [req-83be5844-8494-44ad-929e-ef76aa51b87a req-5d4babda-7e2e-473b-9a26-ece5a4ec454d service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received unexpected event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with vm_state active and task_state rebuilding.
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[922c87be-8e98-4c98-af8f-09e162ef24a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f7e506-05d1-4419-92a8-3d4619fc5fdb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:23 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:23 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:23 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:23 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:23 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:23 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281de9e0>, {}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Disconnecting from: [] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== disconnect_volume: return (94ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:17:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Deleting instance files /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724_del
Nov 14 11:17:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Deletion of /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724_del complete
Nov 14 11:17:23 user nova-compute[75255]: INFO nova.virt.block_device [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Booting with volume ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 at /dev/vdb
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.utils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf24c5e1-2cff-4f72-b4ac-a2e9f4fdfa96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[16109fd6-d9ed-4520-a0b0-7a93056981c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f523bae9-d8ee-4759-9307-d28ec2b66715]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc3b56-138d-49f3-b5a0-bd4b0dadd213]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:17:23 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:17:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a6d9a6-e136-444d-a74a-ef91e868b6df]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG os_brick.utils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:17:23 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updating existing volume attachment record: 275d12e4-b0c4-464f-b973-40a525188247 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:17:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:17:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Creating image(s)
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk 1073741824" returned: 0 in 0.050s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Cannot resize image /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Ensure instance console log exists: /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Start _get_guest_xml network_info=[{"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '275d12e4-b0c4-464f-b973-40a525188247', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9057f65e-8951-49ad-963c-a62d9a8a1724', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'serial': 'ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:17:29 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 11:17:29 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9057f65e-8951-49ad-963c-a62d9a8a1724 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:17:29 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:17:29 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:17:29 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:17:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ef2224-c3a6-456a-8b92-f76e5c8189b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:17:29 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[76828c9b-ccec-4312-ae65-e341a17fe73d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3] added
Nov 14 11:17:29 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb82d246-c9c3-4db9-b08b-87751370ad86]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c34405-90bf-414a-bbe2-1e3fb297fe77]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qKaZUXCO {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qKaZUXCO" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee97bdc-1824-48a9-ae6c-3f524b80cd47]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qKaZUXCO'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1a5ff5-335c-4da6-bfcf-a78a6932047a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6387692e-b21e-493a-bc8d-a21ab064f900]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4233c43-e99e-4836-ac8c-321f9af8e5da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]
Nov 14 11:17:29 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.
Nov 14 11:17:29 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c1682d-ce37-466a-a3a4-e365d9f4a756]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6408981c-a47f-4038-b3e9-1c93433506e8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:29 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[974ef5fc-636d-4588-860e-a53497aa4e83]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:29 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23461626539356136', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461626539356136', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1601762684',display_name='tempest-ServerActionsTestOtherA-server-15543675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1601762684',id=25,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhcx8OgnnF0sgX7lf5Bb/Ju9ZNs5VH3jSw48Yyf9PzYERs0enurSVnV4ZbPhgypn+lr+5fCW5y+08OCGzhvWHfPpd7bjdumzk5JuaEuMh4lWf12uun4pcHA18MdN3akUA==',key_name='tempest-keypair-1173659248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-33uqdt3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=9057f65e-8951-49ad-963c-a62d9a8a1724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:17:30 user nova-compute[75255]:   <uuid>9057f65e-8951-49ad-963c-a62d9a8a1724</uuid>
Nov 14 11:17:30 user nova-compute[75255]:   <name>instance-00000019</name>
Nov 14 11:17:30 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:17:30 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:17:30 user nova-compute[75255]:   <metadata>
Nov 14 11:17:30 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:17:30 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:17:30 user nova-compute[75255]:       <nova:name>tempest-ServerActionsTestOtherA-server-15543675</nova:name>
Nov 14 11:17:30 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:17:29</nova:creationTime>
Nov 14 11:17:30 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:17:30 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:17:30 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:17:30 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:17:30 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:17:30 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:17:30 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:17:30 user nova-compute[75255]:       <nova:owner>
Nov 14 11:17:30 user nova-compute[75255]:         <nova:user uuid="31467e0715d645ecbfbb209e8eba66ed">tempest-ServerActionsTestOtherA-1585033744-project-member</nova:user>
Nov 14 11:17:30 user nova-compute[75255]:         <nova:project uuid="3d1dfe665b5444728fff969e0156d205">tempest-ServerActionsTestOtherA-1585033744</nova:project>
Nov 14 11:17:30 user nova-compute[75255]:       </nova:owner>
Nov 14 11:17:30 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:17:30 user nova-compute[75255]:       <nova:ports>
Nov 14 11:17:30 user nova-compute[75255]:         <nova:port uuid="1aac53ad-ce4c-44b3-a42c-d947e908163a">
Nov 14 11:17:30 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:17:30 user nova-compute[75255]:         </nova:port>
Nov 14 11:17:30 user nova-compute[75255]:       </nova:ports>
Nov 14 11:17:30 user nova-compute[75255]:     </nova:instance>
Nov 14 11:17:30 user nova-compute[75255]:   </metadata>
Nov 14 11:17:30 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:17:30 user nova-compute[75255]:     <system>
Nov 14 11:17:30 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:17:30 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:17:30 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:17:30 user nova-compute[75255]:       <entry name="serial">9057f65e-8951-49ad-963c-a62d9a8a1724</entry>
Nov 14 11:17:30 user nova-compute[75255]:       <entry name="uuid">9057f65e-8951-49ad-963c-a62d9a8a1724</entry>
Nov 14 11:17:30 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:17:30 user nova-compute[75255]:     </system>
Nov 14 11:17:30 user nova-compute[75255]:   </sysinfo>
Nov 14 11:17:30 user nova-compute[75255]:   <os>
Nov 14 11:17:30 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:17:30 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:17:30 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:17:30 user nova-compute[75255]:   </os>
Nov 14 11:17:30 user nova-compute[75255]:   <features>
Nov 14 11:17:30 user nova-compute[75255]:     <acpi/>
Nov 14 11:17:30 user nova-compute[75255]:     <apic/>
Nov 14 11:17:30 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:17:30 user nova-compute[75255]:   </features>
Nov 14 11:17:30 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:17:30 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:17:30 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:17:30 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:17:30 user nova-compute[75255]:   </clock>
Nov 14 11:17:30 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:17:30 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:17:30 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:17:30 user nova-compute[75255]:   </cpu>
Nov 14 11:17:30 user nova-compute[75255]:   <devices>
Nov 14 11:17:30 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:17:30 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:17:30 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk"/>
Nov 14 11:17:30 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:17:30 user nova-compute[75255]:     </disk>
Nov 14 11:17:30 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:17:30 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:17:30 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:17:30 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:17:30 user nova-compute[75255]:       <serial>ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3</serial>
Nov 14 11:17:30 user nova-compute[75255]:     </disk>
Nov 14 11:17:30 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:17:30 user nova-compute[75255]:       <mac address="fa:16:3e:78:56:18"/>
Nov 14 11:17:30 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:17:30 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:17:30 user nova-compute[75255]:       <target dev="tap1aac53ad-ce"/>
Nov 14 11:17:30 user nova-compute[75255]:     </interface>
Nov 14 11:17:30 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:17:30 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/console.log" append="off"/>
Nov 14 11:17:30 user nova-compute[75255]:     </serial>
Nov 14 11:17:30 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:17:30 user nova-compute[75255]:     <video>
Nov 14 11:17:30 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:17:30 user nova-compute[75255]:     </video>
Nov 14 11:17:30 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:17:30 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:17:30 user nova-compute[75255]:     </rng>
Nov 14 11:17:30 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:17:30 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:17:30 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:17:30 user nova-compute[75255]:     </memballoon>
Nov 14 11:17:30 user nova-compute[75255]:   </devices>
Nov 14 11:17:30 user nova-compute[75255]: </domain>
Nov 14 11:17:30 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1601762684',display_name='tempest-ServerActionsTestOtherA-server-15543675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1601762684',id=25,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhcx8OgnnF0sgX7lf5Bb/Ju9ZNs5VH3jSw48Yyf9PzYERs0enurSVnV4ZbPhgypn+lr+5fCW5y+08OCGzhvWHfPpd7bjdumzk5JuaEuMh4lWf12uun4pcHA18MdN3akUA==',key_name='tempest-keypair-1173659248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-33uqdt3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=9057f65e-8951-49ad-963c-a62d9a8a1724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG os_vif [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '649634a5-f1f1-533b-a683-6ffc2ff6404c', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aac53ad-ce, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aac53ad-ce, col_values=(('qos', UUID('25392a2b-ae37-444a-a474-6460f5fd51c4')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aac53ad-ce, col_values=(('external_ids', {'iface-id': '1aac53ad-ce4c-44b3-a42c-d947e908163a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:56:18', 'vm-uuid': '9057f65e-8951-49ad-963c-a62d9a8a1724'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:30 user nova-compute[75255]: INFO os_vif [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce')
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:17:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No VIF found with MAC fa:16:3e:78:56:18, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:17:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-7c627f12-cbe2-4d39-9e81-511458b257d5 req-58fcc7d2-eb2c-4ce2-9ca3-0331d52b9d0e service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7c627f12-cbe2-4d39-9e81-511458b257d5 req-58fcc7d2-eb2c-4ce2-9ca3-0331d52b9d0e service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7c627f12-cbe2-4d39-9e81-511458b257d5 req-58fcc7d2-eb2c-4ce2-9ca3-0331d52b9d0e service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7c627f12-cbe2-4d39-9e81-511458b257d5 req-58fcc7d2-eb2c-4ce2-9ca3-0331d52b9d0e service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-7c627f12-cbe2-4d39-9e81-511458b257d5 req-58fcc7d2-eb2c-4ce2-9ca3-0331d52b9d0e service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:17:32 user nova-compute[75255]: WARNING nova.compute.manager [req-7c627f12-cbe2-4d39-9e81-511458b257d5 req-58fcc7d2-eb2c-4ce2-9ca3-0331d52b9d0e service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received unexpected event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with vm_state active and task_state rebuild_spawning.
Nov 14 11:17:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:17:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance spawned successfully.
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-d667110a-a17d-4783-9704-ad97740cf77c req-e9fa9218-eef0-4a67-9ed9-63eeba613d39 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d667110a-a17d-4783-9704-ad97740cf77c req-e9fa9218-eef0-4a67-9ed9-63eeba613d39 service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d667110a-a17d-4783-9704-ad97740cf77c req-e9fa9218-eef0-4a67-9ed9-63eeba613d39 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d667110a-a17d-4783-9704-ad97740cf77c req-e9fa9218-eef0-4a67-9ed9-63eeba613d39 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-d667110a-a17d-4783-9704-ad97740cf77c req-e9fa9218-eef0-4a67-9ed9-63eeba613d39 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:17:34 user nova-compute[75255]: WARNING nova.compute.manager [req-d667110a-a17d-4783-9704-ad97740cf77c req-e9fa9218-eef0-4a67-9ed9-63eeba613d39 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received unexpected event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with vm_state active and task_state rebuild_spawning.
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75255) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de42d50a-40d4-45cf-9eae-ed5a50cab1f0 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.082s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 is timed out.
Nov 14 11:17:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully detached device vdb from instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 from the live domain config.
Nov 14 11:17:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSRAUjkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:17:35 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[394a45bd-2644-4b9d-966b-d17df5fe5fb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:17:35 user nova-compute[75255]: No targets found.
Nov 14 11:17:35 user nova-compute[75255]: iSNS:
Nov 14 11:17:35 user nova-compute[75255]: No targets found.
Nov 14 11:17:35 user nova-compute[75255]: STATIC:
Nov 14 11:17:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3
Nov 14 11:17:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3
Nov 14 11:17:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81
Nov 14 11:17:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:17:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:17:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:17:35 user nova-compute[75255]: FIRMWARE:
Nov 14 11:17:35 user nova-compute[75255]: No targets found.
Nov 14 11:17:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:17:35 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:17:35 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb55a5-76e4-4093-8837-65ab5538791f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[745d4472-5877-4831-b2b8-61ff917bdfc1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:35 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:35 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:35 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:17:35 user nova-compute[75255]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 (non-flash)
Nov 14 11:17:35 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:17:35 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:17:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086c80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81'): ({'sde'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Removing single pathed devices sde {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56cb45b-0bf2-4c5d-a2cc-a57b0ed33037]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2466a13e-a8bc-4d08-9e28-d3182dc8a53d]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Flushing IO for device /dev/sde {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:17:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02bb621-219c-410d-b542-befa68acd167]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5ad8b5-20a6-4d59-9410-270d17ea6f75]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d7321-52cf-4aa0-aff0-564af429bcd8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4515574f-8b30-4f3d-aaae-ca7fa13267e1]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260]
Nov 14 11:17:36 user nova-compute[75255]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81, portal: 172.16.0.220,3260] successful.
Nov 14 11:17:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b41a48-88b1-4f91-b2e0-26f7454d5e81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[376edf11-14af-4237-bba8-ad8840d65380]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] <== disconnect_volume: return (333ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:17:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.objects.instance [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'flavor' on Instance uuid c27772f3-df22-4b0b-bb50-8fdf8de7c846 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1290300c-92e0-4262-8ef5-155b01eec715 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.970s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:17:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7692MB free_disk=25.12472152709961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c27772f3-df22-4b0b-bb50-8fdf8de7c846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9057f65e-8951-49ad-963c-a62d9a8a1724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 69fe826e-b67c-4109-914d-94c04d09a216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:17:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.959s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:17:38 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:17:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:17:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [{"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-c27772f3-df22-4b0b-bb50-8fdf8de7c846" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:17:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:17:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:17:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:17:44 user nova-compute[75255]: INFO nova.compute.claims [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Claim successful on node user
Nov 14 11:17:44 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:17:44 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:17:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.policy [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51df3343a8524c14ac4788217825a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb2db5b35b344b4a0f939695dda98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:17:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Creating image(s)
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "/opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "/opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "/opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk 1073741824" returned: 0 in 0.054s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Successfully created port: 2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:17:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Cannot resize image /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Ensure instance console log exists: /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Successfully updated port: 2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "refresh_cache-5da8ee6f-27ab-4f39-914d-d2b277f913b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquired lock "refresh_cache-5da8ee6f-27ab-4f39-914d-d2b277f913b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received event network-changed-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Refreshing instance network info cache due to event network-changed-2550a711-fd0a-4f2c-875c-33e4593d1eca. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] Acquiring lock "refresh_cache-5da8ee6f-27ab-4f39-914d-d2b277f913b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Updating instance_info_cache with network_info: [{"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Releasing lock "refresh_cache-5da8ee6f-27ab-4f39-914d-d2b277f913b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Instance network_info: |[{"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] Acquired lock "refresh_cache-5da8ee6f-27ab-4f39-914d-d2b277f913b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.neutron [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Refreshing network info cache for port 2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Start _get_guest_xml network_info=[{"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:17:46 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:17:46 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-527643866',display_name='tempest-VolumesActionsTest-instance-527643866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-527643866',id=28,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feb2db5b35b344b4a0f939695dda98ec',ramdisk_id='',reservation_id='r-3ejdogmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934295409',owner_user_name='tempest-VolumesActionsTest-1934295409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:17:45Z,user_data=None,user_id='51df3343a8524c14ac4788217825a99f',uuid=5da8ee6f-27ab-4f39-914d-d2b277f913b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converting VIF {"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ba:a1,bridge_name='br-int',has_traffic_filtering=True,id=2550a711-fd0a-4f2c-875c-33e4593d1eca,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2550a711-fd') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lazy-loading 'pci_devices' on Instance uuid 5da8ee6f-27ab-4f39-914d-d2b277f913b9 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:17:46 user nova-compute[75255]:   <uuid>5da8ee6f-27ab-4f39-914d-d2b277f913b9</uuid>
Nov 14 11:17:46 user nova-compute[75255]:   <name>instance-0000001c</name>
Nov 14 11:17:46 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:17:46 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:17:46 user nova-compute[75255]:   <metadata>
Nov 14 11:17:46 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:17:46 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:17:46 user nova-compute[75255]:       <nova:name>tempest-VolumesActionsTest-instance-527643866</nova:name>
Nov 14 11:17:46 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:17:46</nova:creationTime>
Nov 14 11:17:46 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:17:46 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:17:46 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:17:46 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:17:46 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:17:46 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:17:46 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:17:46 user nova-compute[75255]:       <nova:owner>
Nov 14 11:17:46 user nova-compute[75255]:         <nova:user uuid="51df3343a8524c14ac4788217825a99f">tempest-VolumesActionsTest-1934295409-project-member</nova:user>
Nov 14 11:17:46 user nova-compute[75255]:         <nova:project uuid="feb2db5b35b344b4a0f939695dda98ec">tempest-VolumesActionsTest-1934295409</nova:project>
Nov 14 11:17:46 user nova-compute[75255]:       </nova:owner>
Nov 14 11:17:46 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:17:46 user nova-compute[75255]:       <nova:ports>
Nov 14 11:17:46 user nova-compute[75255]:         <nova:port uuid="2550a711-fd0a-4f2c-875c-33e4593d1eca">
Nov 14 11:17:46 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 11:17:46 user nova-compute[75255]:         </nova:port>
Nov 14 11:17:46 user nova-compute[75255]:       </nova:ports>
Nov 14 11:17:46 user nova-compute[75255]:     </nova:instance>
Nov 14 11:17:46 user nova-compute[75255]:   </metadata>
Nov 14 11:17:46 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:17:46 user nova-compute[75255]:     <system>
Nov 14 11:17:46 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:17:46 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:17:46 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:17:46 user nova-compute[75255]:       <entry name="serial">5da8ee6f-27ab-4f39-914d-d2b277f913b9</entry>
Nov 14 11:17:46 user nova-compute[75255]:       <entry name="uuid">5da8ee6f-27ab-4f39-914d-d2b277f913b9</entry>
Nov 14 11:17:46 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:17:46 user nova-compute[75255]:     </system>
Nov 14 11:17:46 user nova-compute[75255]:   </sysinfo>
Nov 14 11:17:46 user nova-compute[75255]:   <os>
Nov 14 11:17:46 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:17:46 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:17:46 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:17:46 user nova-compute[75255]:   </os>
Nov 14 11:17:46 user nova-compute[75255]:   <features>
Nov 14 11:17:46 user nova-compute[75255]:     <acpi/>
Nov 14 11:17:46 user nova-compute[75255]:     <apic/>
Nov 14 11:17:46 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:17:46 user nova-compute[75255]:   </features>
Nov 14 11:17:46 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:17:46 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:17:46 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:17:46 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:17:46 user nova-compute[75255]:   </clock>
Nov 14 11:17:46 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:17:46 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:17:46 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:17:46 user nova-compute[75255]:   </cpu>
Nov 14 11:17:46 user nova-compute[75255]:   <devices>
Nov 14 11:17:46 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:17:46 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:17:46 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk"/>
Nov 14 11:17:46 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:17:46 user nova-compute[75255]:     </disk>
Nov 14 11:17:46 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:17:46 user nova-compute[75255]:       <mac address="fa:16:3e:6e:ba:a1"/>
Nov 14 11:17:46 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:17:46 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:17:46 user nova-compute[75255]:       <target dev="tap2550a711-fd"/>
Nov 14 11:17:46 user nova-compute[75255]:     </interface>
Nov 14 11:17:46 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:17:46 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/console.log" append="off"/>
Nov 14 11:17:46 user nova-compute[75255]:     </serial>
Nov 14 11:17:46 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:17:46 user nova-compute[75255]:     <video>
Nov 14 11:17:46 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:17:46 user nova-compute[75255]:     </video>
Nov 14 11:17:46 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:17:46 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:17:46 user nova-compute[75255]:     </rng>
Nov 14 11:17:46 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:17:46 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:17:46 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:17:46 user nova-compute[75255]:     </memballoon>
Nov 14 11:17:46 user nova-compute[75255]:   </devices>
Nov 14 11:17:46 user nova-compute[75255]: </domain>
Nov 14 11:17:46 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-527643866',display_name='tempest-VolumesActionsTest-instance-527643866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-527643866',id=28,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feb2db5b35b344b4a0f939695dda98ec',ramdisk_id='',reservation_id='r-3ejdogmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934295409',owner_user_name='tempest-VolumesActionsTest-1934295409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:17:45Z,user_data=None,user_id='51df3343a8524c14ac4788217825a99f',uuid=5da8ee6f-27ab-4f39-914d-d2b277f913b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converting VIF {"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ba:a1,bridge_name='br-int',has_traffic_filtering=True,id=2550a711-fd0a-4f2c-875c-33e4593d1eca,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2550a711-fd') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG os_vif [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ba:a1,bridge_name='br-int',has_traffic_filtering=True,id=2550a711-fd0a-4f2c-875c-33e4593d1eca,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2550a711-fd') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc7314c7-3e60-588e-b041-a8ae0de74bb1', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2550a711-fd, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2550a711-fd, col_values=(('qos', UUID('54468d2f-25db-4d4f-862e-ec1154d6797f')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2550a711-fd, col_values=(('external_ids', {'iface-id': '2550a711-fd0a-4f2c-875c-33e4593d1eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:ba:a1', 'vm-uuid': '5da8ee6f-27ab-4f39-914d-d2b277f913b9'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:46 user nova-compute[75255]: INFO os_vif [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ba:a1,bridge_name='br-int',has_traffic_filtering=True,id=2550a711-fd0a-4f2c-875c-33e4593d1eca,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2550a711-fd')
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] No VIF found with MAC fa:16:3e:6e:ba:a1, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.neutron [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Updated VIF entry in instance network info cache for port 2550a711-fd0a-4f2c-875c-33e4593d1eca. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG nova.network.neutron [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Updating instance_info_cache with network_info: [{"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:17:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8b2edc00-7782-4b06-9209-33c6e01799ff req-875a4672-b75f-48a9-bf43-ab334f707d81 service nova] Releasing lock "refresh_cache-5da8ee6f-27ab-4f39-914d-d2b277f913b9" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-70348a0a-6530-43df-8f45-71599e812743 req-5f769a33-95e9-4332-a018-30edc9a44c0e service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received event network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-70348a0a-6530-43df-8f45-71599e812743 req-5f769a33-95e9-4332-a018-30edc9a44c0e service nova] Acquiring lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-70348a0a-6530-43df-8f45-71599e812743 req-5f769a33-95e9-4332-a018-30edc9a44c0e service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-70348a0a-6530-43df-8f45-71599e812743 req-5f769a33-95e9-4332-a018-30edc9a44c0e service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-70348a0a-6530-43df-8f45-71599e812743 req-5f769a33-95e9-4332-a018-30edc9a44c0e service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] No waiting events found dispatching network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:17:48 user nova-compute[75255]: WARNING nova.compute.manager [req-70348a0a-6530-43df-8f45-71599e812743 req-5f769a33-95e9-4332-a018-30edc9a44c0e service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received unexpected event network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca for instance with vm_state building and task_state spawning.
Nov 14 11:17:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:17:50 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Instance spawned successfully.
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-56f9480d-f60a-482e-b78b-63473c99b26b req-c5ccbe65-de7c-441f-96b0-406f1965d87d service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received event network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-56f9480d-f60a-482e-b78b-63473c99b26b req-c5ccbe65-de7c-441f-96b0-406f1965d87d service nova] Acquiring lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-56f9480d-f60a-482e-b78b-63473c99b26b req-c5ccbe65-de7c-441f-96b0-406f1965d87d service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-56f9480d-f60a-482e-b78b-63473c99b26b req-c5ccbe65-de7c-441f-96b0-406f1965d87d service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-56f9480d-f60a-482e-b78b-63473c99b26b req-c5ccbe65-de7c-441f-96b0-406f1965d87d service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] No waiting events found dispatching network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:17:50 user nova-compute[75255]: WARNING nova.compute.manager [req-56f9480d-f60a-482e-b78b-63473c99b26b req-c5ccbe65-de7c-441f-96b0-406f1965d87d service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received unexpected event network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca for instance with vm_state building and task_state spawning.
Nov 14 11:17:50 user nova-compute[75255]: INFO nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 14 11:17:50 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:17:50 user nova-compute[75255]: INFO nova.compute.manager [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Took 5.74 seconds to build instance.
Nov 14 11:17:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d794e91a-75dd-47fc-867f-39fc9ded6518 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.842s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:17:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:17:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing instance network info cache due to event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:17:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] Acquiring lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:17:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] Acquired lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:17:58 user nova-compute[75255]: DEBUG nova.network.neutron [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:17:59 user nova-compute[75255]: DEBUG nova.network.neutron [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updated VIF entry in instance network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:17:59 user nova-compute[75255]: DEBUG nova.network.neutron [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:17:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-61202d9e-372b-41f8-a4fd-d79a11a952a6 req-85b43021-a210-4b2b-ac22-e110a14b7cc6 service nova] Releasing lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:17:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:17:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:17:59 user nova-compute[75255]: INFO nova.compute.manager [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] instance snapshotting
Nov 14 11:17:59 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Beginning live snapshot process
Nov 14 11:17:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkb9s1trz/1c321e1e52694e2e97b14d5e6de0c39d.delta 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkb9s1trz/1c321e1e52694e2e97b14d5e6de0c39d.delta 1073741824" returned: 0 in 0.054s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 11:18:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:18:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:18:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 11:18:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:01 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:18:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkb9s1trz/1c321e1e52694e2e97b14d5e6de0c39d.delta /opt/stack/data/nova/instances/snapshots/tmpkb9s1trz/1c321e1e52694e2e97b14d5e6de0c39d {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkb9s1trz/1c321e1e52694e2e97b14d5e6de0c39d.delta /opt/stack/data/nova/instances/snapshots/tmpkb9s1trz/1c321e1e52694e2e97b14d5e6de0c39d" returned: 0 in 0.313s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Snapshot extracted, beginning image upload
Nov 14 11:18:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Snapshot image upload complete
Nov 14 11:18:04 user nova-compute[75255]: INFO nova.compute.manager [None req-dd058496-1582-43c9-8b57-4fbd633e5b14 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Took 4.83 seconds to snapshot the instance on the hypervisor.
Nov 14 11:18:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:07 user nova-compute[75255]: INFO nova.compute.manager [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Terminating instance
Nov 14 11:18:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-097e2d86-3aa3-40af-b368-b1bdac43d186 req-2e9e23bb-f5bf-4819-84fa-997a406a74ed service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-unplugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-097e2d86-3aa3-40af-b368-b1bdac43d186 req-2e9e23bb-f5bf-4819-84fa-997a406a74ed service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-097e2d86-3aa3-40af-b368-b1bdac43d186 req-2e9e23bb-f5bf-4819-84fa-997a406a74ed service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-097e2d86-3aa3-40af-b368-b1bdac43d186 req-2e9e23bb-f5bf-4819-84fa-997a406a74ed service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-097e2d86-3aa3-40af-b368-b1bdac43d186 req-2e9e23bb-f5bf-4819-84fa-997a406a74ed service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-unplugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-097e2d86-3aa3-40af-b368-b1bdac43d186 req-2e9e23bb-f5bf-4819-84fa-997a406a74ed service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-unplugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:18:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Instance destroyed successfully.
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lazy-loading 'resources' on Instance uuid c27772f3-df22-4b0b-bb50-8fdf8de7c846 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-565416391',display_name='tempest-TestMinimumBasicScenario-server-565416391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-565416391',id=20,image_ref='27563495-7709-4f47-b9c9-d88dd1bf7c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXNbwGD906zGqD1yaGV94lEM+IqX5JwRyNE90DTvqJNT00ayr3FwRmEcQ9YWutZ/7lpDYO4fRmckpQAMtGPKKFTEK3Jcm+KKVaBxyPRoSBNXkQSbNVs1IcjhwurfUn+7g==',key_name='tempest-TestMinimumBasicScenario-1375661165',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:13:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e39b62cd90bd47778d70766751118de4',ramdisk_id='',reservation_id='r-02eqj898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27563495-7709-4f47-b9c9-d88dd1bf7c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092480951',owner_user_name='tempest-TestMinimumBasicScenario-1092480951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:15:30Z,user_data=None,user_id='b20309458694432394da4ee00f67638b',uuid=c27772f3-df22-4b0b-bb50-8fdf8de7c846,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converting VIF {"id": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "address": "fa:16:3e:07:f0:0c", "network": {"id": "011007ff-6bf4-40a8-9ddc-3c61310ee6bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539403593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e39b62cd90bd47778d70766751118de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fbf551-a2", "ovs_interfaceid": "01fbf551-a2f6-4910-9b9a-c27a216c78c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:f0:0c,bridge_name='br-int',has_traffic_filtering=True,id=01fbf551-a2f6-4910-9b9a-c27a216c78c9,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fbf551-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG os_vif [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:f0:0c,bridge_name='br-int',has_traffic_filtering=True,id=01fbf551-a2f6-4910-9b9a-c27a216c78c9,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fbf551-a2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01fbf551-a2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27d854fa-80d1-4ed2-9a89-b1c59a83f96c) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:18:08 user nova-compute[75255]: INFO os_vif [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:f0:0c,bridge_name='br-int',has_traffic_filtering=True,id=01fbf551-a2f6-4910-9b9a-c27a216c78c9,network=Network(011007ff-6bf4-40a8-9ddc-3c61310ee6bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fbf551-a2')
Nov 14 11:18:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Deleting instance files /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846_del
Nov 14 11:18:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Deletion of /opt/stack/data/nova/instances/c27772f3-df22-4b0b-bb50-8fdf8de7c846_del complete
Nov 14 11:18:08 user nova-compute[75255]: INFO nova.compute.manager [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 11:18:08 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:18:08 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:18:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:09 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:18:09 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Took 1.11 seconds to deallocate network for instance.
Nov 14 11:18:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-a5f021ab-cdb2-43d5-a314-28b2dc899a1d req-9ff26ac1-8b82-497f-ae4b-f822ff0e02f8 service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-deleted-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-720d8fba-aba0-4bad-b127-7bfd175fd4d6 req-5776dee9-59dd-4c38-9b20-3000e72bd43a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-720d8fba-aba0-4bad-b127-7bfd175fd4d6 req-5776dee9-59dd-4c38-9b20-3000e72bd43a service nova] Acquiring lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-720d8fba-aba0-4bad-b127-7bfd175fd4d6 req-5776dee9-59dd-4c38-9b20-3000e72bd43a service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-720d8fba-aba0-4bad-b127-7bfd175fd4d6 req-5776dee9-59dd-4c38-9b20-3000e72bd43a service nova] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-720d8fba-aba0-4bad-b127-7bfd175fd4d6 req-5776dee9-59dd-4c38-9b20-3000e72bd43a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] No waiting events found dispatching network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:10 user nova-compute[75255]: WARNING nova.compute.manager [req-720d8fba-aba0-4bad-b127-7bfd175fd4d6 req-5776dee9-59dd-4c38-9b20-3000e72bd43a service nova] [instance: c27772f3-df22-4b0b-bb50-8fdf8de7c846] Received unexpected event network-vif-plugged-01fbf551-a2f6-4910-9b9a-c27a216c78c9 for instance with vm_state deleted and task_state None.
Nov 14 11:18:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:18:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:18:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:10 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Deleted allocations for instance c27772f3-df22-4b0b-bb50-8fdf8de7c846
Nov 14 11:18:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a015fadb-54ed-4a70-bf13-d4d7c1a50895 tempest-TestMinimumBasicScenario-1092480951 tempest-TestMinimumBasicScenario-1092480951-project-member] Lock "c27772f3-df22-4b0b-bb50-8fdf8de7c846" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.534s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:12 user nova-compute[75255]: INFO nova.compute.manager [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Unrescuing
Nov 14 11:18:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:18:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:18:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'flavor' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-caeb5b49-edc1-4dca-917b-6ae6fe30f35f req-c0442f0f-f69e-42b8-becf-09d3ddb196c1 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-caeb5b49-edc1-4dca-917b-6ae6fe30f35f req-c0442f0f-f69e-42b8-becf-09d3ddb196c1 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-caeb5b49-edc1-4dca-917b-6ae6fe30f35f req-c0442f0f-f69e-42b8-becf-09d3ddb196c1 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-caeb5b49-edc1-4dca-917b-6ae6fe30f35f req-c0442f0f-f69e-42b8-becf-09d3ddb196c1 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-caeb5b49-edc1-4dca-917b-6ae6fe30f35f req-c0442f0f-f69e-42b8-becf-09d3ddb196c1 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:13 user nova-compute[75255]: WARNING nova.compute.manager [req-caeb5b49-edc1-4dca-917b-6ae6fe30f35f req-c0442f0f-f69e-42b8-becf-09d3ddb196c1 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance destroyed successfully.
Nov 14 11:18:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:15 user nova-compute[75255]: WARNING nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:15 user nova-compute[75255]: WARNING nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:15 user nova-compute[75255]: WARNING nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:15 user nova-compute[75255]: WARNING nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:15 user nova-compute[75255]: WARNING nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:15 user nova-compute[75255]: WARNING nova.compute.manager [req-6b22d90b-2830-4f87-8600-6b59ca5a2461 req-ecdd3d7e-6ff9-479b-a45c-8f4dbbf4dd18 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4c6b58c8-4bda-4e00-b201-946076f7c445 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:18:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-6118a711-78ef-4544-a802-88f02e9765f5 req-98907aa7-6745-478d-9625-5b7ff9033670 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6118a711-78ef-4544-a802-88f02e9765f5 req-98907aa7-6745-478d-9625-5b7ff9033670 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6118a711-78ef-4544-a802-88f02e9765f5 req-98907aa7-6745-478d-9625-5b7ff9033670 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6118a711-78ef-4544-a802-88f02e9765f5 req-98907aa7-6745-478d-9625-5b7ff9033670 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-6118a711-78ef-4544-a802-88f02e9765f5 req-98907aa7-6745-478d-9625-5b7ff9033670 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:17 user nova-compute[75255]: WARNING nova.compute.manager [req-6118a711-78ef-4544-a802-88f02e9765f5 req-98907aa7-6745-478d-9625-5b7ff9033670 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state active and task_state None.
Nov 14 11:18:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:18:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:18:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:18:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:18:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:30 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:18:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7752MB free_disk=25.04657745361328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9057f65e-8951-49ad-963c-a62d9a8a1724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 69fe826e-b67c-4109-914d-94c04d09a216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5da8ee6f-27ab-4f39-914d-d2b277f913b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:18:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:18:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [{"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-943d1e23-bb99-4499-83db-eca996c3fedf" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:18:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-changed-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Refreshing instance network info cache due to event network-changed-aea1359b-9af0-4ab0-b694-533c76eaea02. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] Acquiring lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] Acquired lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Refreshing network info cache for port aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updated VIF entry in instance network info cache for port aea1359b-9af0-4ab0-b694-533c76eaea02. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updating instance_info_cache with network_info: [{"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:18:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82003301-564c-4f5a-98ec-7146104a3435 req-05b57827-449a-4cc6-8998-0aad576c34d7 service nova] Releasing lock "refresh_cache-69fe826e-b67c-4109-914d-94c04d09a216" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid 69fe826e-b67c-4109-914d-94c04d09a216 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:44 user nova-compute[75255]: INFO nova.compute.manager [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Unrescuing
Nov 14 11:18:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquired lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:44 user nova-compute[75255]: INFO nova.compute.manager [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Attaching volume 436dbcdb-9e20-48fa-8dcc-c411fed3310b to /dev/vdb
Nov 14 11:18:45 user nova-compute[75255]: DEBUG os_brick.utils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd799d3-9b8e-471b-af12-408844981644]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52b346-d8d9-4b17-afb8-e9e17a37f3f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c03aa28-f191-458f-81d5-ac50ba0069fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0486c500-b6a1-44c2-892a-f26d5b9949d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:18:45 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1aeb41-b01a-4ad1-8c8b-d8e395faf673]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG os_brick.utils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updating existing volume attachment record: f0dfe486-9579-4d03-aac0-a40dd1409bc9 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Releasing lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'flavor' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-66e87310-e873-4b5a-8f3d-0ec9d938881f req-3e44a484-3b34-43c3-8e93-00ff0622b422 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-66e87310-e873-4b5a-8f3d-0ec9d938881f req-3e44a484-3b34-43c3-8e93-00ff0622b422 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-66e87310-e873-4b5a-8f3d-0ec9d938881f req-3e44a484-3b34-43c3-8e93-00ff0622b422 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-66e87310-e873-4b5a-8f3d-0ec9d938881f req-3e44a484-3b34-43c3-8e93-00ff0622b422 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-66e87310-e873-4b5a-8f3d-0ec9d938881f req-3e44a484-3b34-43c3-8e93-00ff0622b422 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:45 user nova-compute[75255]: WARNING nova.compute.manager [req-66e87310-e873-4b5a-8f3d-0ec9d938881f req-3e44a484-3b34-43c3-8e93-00ff0622b422 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance destroyed successfully.
Nov 14 11:18:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:47 user nova-compute[75255]: WARNING nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:47 user nova-compute[75255]: WARNING nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:47 user nova-compute[75255]: WARNING nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:47 user nova-compute[75255]: WARNING nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:47 user nova-compute[75255]: WARNING nova.compute.manager [req-3c7fb481-0f80-4647-96e6-272bb62ab932 req-c9d5ac67-c45b-4eea-b1f6-5d9d00558880 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:18:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'taEwzXnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:18:49 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:18:49 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:18:49 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[733b3425-9164-47a0-bcfc-60c0a76cc7ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:18:49 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861a7eb-608e-4687-b587-0b03865f5523]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b] added
Nov 14 11:18:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8201d4a7-e741-423d-beab-cd6268c8d95b tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8257709-162b-4aeb-9567-62e0e16b8ce3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1938274b-9dc0-4dcb-9ec6-9d02e58675e8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v taEwzXnd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v taEwzXnd" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[747451c7-ee05-483f-a698-3c4a7d3b615e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'taEwzXnd'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86658fe-c816-44fc-b19c-99c2bf2377f2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c7b6b3-1c29-43f7-b4f7-79beb366f2f5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbcdc57-52f6-4b08-877f-67d6f2fd41f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260]
Nov 14 11:18:49 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260] successful.
Nov 14 11:18:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[225aa1f5-8931-48b4-b49e-77c1cabe34c4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79b1e24-022f-42b9-88cb-2fdf980caaa9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b (non-flash)
Nov 14 11:18:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:18:49 user nova-compute[75255]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b (non-flash)
Nov 14 11:18:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217ec54-f10d-469b-8d52-8cc6b8c9bd8a]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'taEwzXnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:49 user nova-compute[75255]: WARNING nova.compute.manager [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state active and task_state None.
Nov 14 11:18:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:18:49 user nova-compute[75255]: WARNING nova.compute.manager [req-8411c91a-a4ec-4caf-bcbe-53bb31f8548f req-a9793151-fc94-4f98-990f-06aca457ab6d service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state active and task_state None.
Nov 14 11:18:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:18:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26438393434303835', 'path': '/dev/sde'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:18:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438393434303835', 'path': '/dev/sde'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:18:50 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid 69fe826e-b67c-4109-914d-94c04d09a216 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:18:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:18:50 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:18:50 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:18:50 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:18:50 user nova-compute[75255]:   <serial>436dbcdb-9e20-48fa-8dcc-c411fed3310b</serial>
Nov 14 11:18:50 user nova-compute[75255]: </disk>
Nov 14 11:18:50 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] No VIF found with MAC fa:16:3e:7d:03:9d, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d334e5ee-3933-4ef8-99bf-2e8aec7da3ab tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.402s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:18:51 user nova-compute[75255]: INFO nova.compute.manager [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Detaching volume 436dbcdb-9e20-48fa-8dcc-c411fed3310b
Nov 14 11:18:51 user nova-compute[75255]: INFO nova.virt.block_device [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Attempting to driver detach volume 436dbcdb-9e20-48fa-8dcc-c411fed3310b from mountpoint /dev/vdb
Nov 14 11:18:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Attempting to detach device vdb from instance 69fe826e-b67c-4109-914d-94c04d09a216 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:18:51 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:18:51 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:18:51 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:18:51 user nova-compute[75255]:   <serial>436dbcdb-9e20-48fa-8dcc-c411fed3310b</serial>
Nov 14 11:18:51 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:18:51 user nova-compute[75255]: </disk>
Nov 14 11:18:51 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:18:51 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully detached device vdb from instance 69fe826e-b67c-4109-914d-94c04d09a216 from the persistent domain config.
Nov 14 11:18:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69fe826e-b67c-4109-914d-94c04d09a216 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:18:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:18:51 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:18:51 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:18:51 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:18:51 user nova-compute[75255]:   <serial>436dbcdb-9e20-48fa-8dcc-c411fed3310b</serial>
Nov 14 11:18:51 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:18:51 user nova-compute[75255]: </disk>
Nov 14 11:18:51 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:18:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69fe826e-b67c-4109-914d-94c04d09a216 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:18:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:18:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:12 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69fe826e-b67c-4109-914d-94c04d09a216 is timed out.
Nov 14 11:19:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully detached device vdb from instance 69fe826e-b67c-4109-914d-94c04d09a216 from the live domain config.
Nov 14 11:19:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'taEwzXnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:19:12 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d2ee0-f3ef-40d4-9c54-69c77976bcbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:19:12 user nova-compute[75255]: No targets found.
Nov 14 11:19:12 user nova-compute[75255]: iSNS:
Nov 14 11:19:12 user nova-compute[75255]: No targets found.
Nov 14 11:19:12 user nova-compute[75255]: STATIC:
Nov 14 11:19:12 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3
Nov 14 11:19:12 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:19:12 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:19:12 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b
Nov 14 11:19:12 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:19:12 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:19:12 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3
Nov 14 11:19:12 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:19:12 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:19:12 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:19:12 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:19:12 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:19:12 user nova-compute[75255]: FIRMWARE:
Nov 14 11:19:12 user nova-compute[75255]: No targets found.
Nov 14 11:19:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:19:12 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:19:12 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb3093-e9e8-4f08-a8ba-d99aa6306ac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179c0f4-9c03-4e3a-b13e-1d33996e24e9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:12 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:12 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:12 user nova-compute[75255]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b (non-flash)
Nov 14 11:19:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:12 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:12 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:12 user nova-compute[75255]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b (non-flash)
Nov 14 11:19:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086ca4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b'): ({'sde'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Removing single pathed devices sde {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e955545-46fa-4281-9c15-26f9e8848f5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7708845-add1-405b-8066-d169e825e08b]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Flushing IO for device /dev/sde {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c253c8-63b4-4e05-9c86-463f7c9983b8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7a3c73-8cea-4da9-afbb-8209575021e3]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cd5dfa-ba7b-41d5-865e-c399364ba442]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[979a1d8b-4e07-4ab1-a3b1-437f559801a2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260]
Nov 14 11:19:12 user nova-compute[75255]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b, portal: 172.16.0.220,3260] successful.
Nov 14 11:19:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436dbcdb-9e20-48fa-8dcc-c411fed3310b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb059ce0-b707-42dc-ab8d-a396f31263cb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] <== disconnect_volume: return (308ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:19:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:19:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'flavor' on Instance uuid 69fe826e-b67c-4109-914d-94c04d09a216 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:19:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e05d06f-1638-42a1-a4c3-f67b1cefa012 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:19:21 user nova-compute[75255]: INFO nova.compute.claims [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Claim successful on node user
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:19:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG nova.policy [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a68d5e2b8b64a289abf08bba42e1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b5b339310242ea8837a4a3ffee6532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:19:21 user nova-compute[75255]: INFO nova.virt.block_device [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Booting with volume 48fbc53d-534d-4d32-8319-6cc35b8cf74b at /dev/vda
Nov 14 11:19:21 user nova-compute[75255]: DEBUG os_brick.utils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[457cace6-390d-4f43-9a9a-3cde8aafd2e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9e707-06d1-460e-887f-b64dfff0a55f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c497a-8246-4c0a-8d69-17bd219819ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0182c74e-c332-487a-884d-1abaa4d85182]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:19:22 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:19:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbe3c1a-940c-4213-9e8b-caa840af292b]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG os_brick.utils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating existing volume attachment record: df381a6e-54b6-405c-8c0f-7fc22daf86cd {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:19:22 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Successfully created port: 7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Successfully updated port: 7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing instance network info cache due to event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance network_info: |[{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:19:23 user nova-compute[75255]: DEBUG nova.network.neutron [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:19:24 user nova-compute[75255]: DEBUG nova.network.neutron [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updated VIF entry in instance network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:19:24 user nova-compute[75255]: DEBUG nova.network.neutron [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-51b26d63-565c-4a6b-9438-374f18ff414d req-13ff58ad-86c0-49b4-adec-355ad93e13fa service nova] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:19:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:19:26 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Creating image(s)
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Ensure instance console log exists: /opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Start _get_guest_xml network_info=[{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'df381a6e-54b6-405c-8c0f-7fc22daf86cd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68bca729-db5f-4edd-9549-979c5b00e49b', 'attached_at': '', 'detached_at': '', 'volume_id': '48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'serial': '48fbc53d-534d-4d32-8319-6cc35b8cf74b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:19:26 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:19:26 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:19:26 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:19:26 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:19:26 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6099585-38d3-4e0f-beef-d4da07cd15db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:19:26 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[980d86ac-fb3e-4648-a8ea-58f5cdd2673c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b] added
Nov 14 11:19:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dcd3ad-4adc-4042-8205-ac3f480b3981]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed77b6f-b856-4705-8fe6-d6af2b5e934f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWxZBNVU {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWxZBNVU" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a214e3-6c3f-4e62-8d60-772da8e39ea4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wWxZBNVU'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf774a0-1775-47cd-bd77-30a63fd61f4b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb853f21-9f71-4aa1-917d-ac2671d64263]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b2b02a-c3a2-4b22-9a89-9d4ba1a6ff55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]
Nov 14 11:19:26 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.
Nov 14 11:19:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ecae6-8317-41bc-9aa7-92dcad0bec2c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f356f9-c081-4611-8369-090f33d15838]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:19:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:26 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:19:26 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6742d6-3b87-4368-bec5-8b08b55ddb31]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:26 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23832303062393535', 'path': '/dev/sde'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832303062393535', 'path': '/dev/sde'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-805539077',display_name='tempest-TestShelveInstance-server-805539077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-805539077',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTHn8Uben8kK2HaTK5LXH7Z3lHOnonZd+cDcfzzZ1UJxtCZoI3X6OBueXUBHhGY1k7PvPP/6+WSVMWzc5YYhg+EbZ0iUNr7HCK+glYRgYaTtTB0GabI5QPZwmVJZX9EDw==',key_name='tempest-TestShelveInstance-287110248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b5b339310242ea8837a4a3ffee6532',ramdisk_id='',reservation_id='r-g6gjeea3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1188210100',owner_user_name='tempest-TestShelveInstance-1188210100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:19:22Z,user_data=None,user_id='0a68d5e2b8b64a289abf08bba42e1033',uuid=68bca729-db5f-4edd-9549-979c5b00e49b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converting VIF {"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'pci_devices' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:19:27 user nova-compute[75255]:   <uuid>68bca729-db5f-4edd-9549-979c5b00e49b</uuid>
Nov 14 11:19:27 user nova-compute[75255]:   <name>instance-0000001d</name>
Nov 14 11:19:27 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:19:27 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:19:27 user nova-compute[75255]:   <metadata>
Nov 14 11:19:27 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:19:27 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:19:27 user nova-compute[75255]:       <nova:name>tempest-TestShelveInstance-server-805539077</nova:name>
Nov 14 11:19:27 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:19:26</nova:creationTime>
Nov 14 11:19:27 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:19:27 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:19:27 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:19:27 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:19:27 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:19:27 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:19:27 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:19:27 user nova-compute[75255]:       <nova:owner>
Nov 14 11:19:27 user nova-compute[75255]:         <nova:user uuid="0a68d5e2b8b64a289abf08bba42e1033">tempest-TestShelveInstance-1188210100-project-member</nova:user>
Nov 14 11:19:27 user nova-compute[75255]:         <nova:project uuid="14b5b339310242ea8837a4a3ffee6532">tempest-TestShelveInstance-1188210100</nova:project>
Nov 14 11:19:27 user nova-compute[75255]:       </nova:owner>
Nov 14 11:19:27 user nova-compute[75255]:       <nova:ports>
Nov 14 11:19:27 user nova-compute[75255]:         <nova:port uuid="7a833ede-1eff-4e41-89ff-72ecc27b25bb">
Nov 14 11:19:27 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:19:27 user nova-compute[75255]:         </nova:port>
Nov 14 11:19:27 user nova-compute[75255]:       </nova:ports>
Nov 14 11:19:27 user nova-compute[75255]:     </nova:instance>
Nov 14 11:19:27 user nova-compute[75255]:   </metadata>
Nov 14 11:19:27 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:19:27 user nova-compute[75255]:     <system>
Nov 14 11:19:27 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:19:27 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:19:27 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:19:27 user nova-compute[75255]:       <entry name="serial">68bca729-db5f-4edd-9549-979c5b00e49b</entry>
Nov 14 11:19:27 user nova-compute[75255]:       <entry name="uuid">68bca729-db5f-4edd-9549-979c5b00e49b</entry>
Nov 14 11:19:27 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:19:27 user nova-compute[75255]:     </system>
Nov 14 11:19:27 user nova-compute[75255]:   </sysinfo>
Nov 14 11:19:27 user nova-compute[75255]:   <os>
Nov 14 11:19:27 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:19:27 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:19:27 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:19:27 user nova-compute[75255]:   </os>
Nov 14 11:19:27 user nova-compute[75255]:   <features>
Nov 14 11:19:27 user nova-compute[75255]:     <acpi/>
Nov 14 11:19:27 user nova-compute[75255]:     <apic/>
Nov 14 11:19:27 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:19:27 user nova-compute[75255]:   </features>
Nov 14 11:19:27 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:19:27 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:19:27 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:19:27 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:19:27 user nova-compute[75255]:   </clock>
Nov 14 11:19:27 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:19:27 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:19:27 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:19:27 user nova-compute[75255]:   </cpu>
Nov 14 11:19:27 user nova-compute[75255]:   <devices>
Nov 14 11:19:27 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:19:27 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:19:27 user nova-compute[75255]:       <source dev="/dev/sde"/>
Nov 14 11:19:27 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:19:27 user nova-compute[75255]:       <serial>48fbc53d-534d-4d32-8319-6cc35b8cf74b</serial>
Nov 14 11:19:27 user nova-compute[75255]:     </disk>
Nov 14 11:19:27 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:19:27 user nova-compute[75255]:       <mac address="fa:16:3e:a4:eb:ca"/>
Nov 14 11:19:27 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:19:27 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:19:27 user nova-compute[75255]:       <target dev="tap7a833ede-1e"/>
Nov 14 11:19:27 user nova-compute[75255]:     </interface>
Nov 14 11:19:27 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:19:27 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b/console.log" append="off"/>
Nov 14 11:19:27 user nova-compute[75255]:     </serial>
Nov 14 11:19:27 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:19:27 user nova-compute[75255]:     <video>
Nov 14 11:19:27 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:19:27 user nova-compute[75255]:     </video>
Nov 14 11:19:27 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:19:27 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:19:27 user nova-compute[75255]:     </rng>
Nov 14 11:19:27 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:19:27 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:19:27 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:19:27 user nova-compute[75255]:     </memballoon>
Nov 14 11:19:27 user nova-compute[75255]:   </devices>
Nov 14 11:19:27 user nova-compute[75255]: </domain>
Nov 14 11:19:27 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-805539077',display_name='tempest-TestShelveInstance-server-805539077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-805539077',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTHn8Uben8kK2HaTK5LXH7Z3lHOnonZd+cDcfzzZ1UJxtCZoI3X6OBueXUBHhGY1k7PvPP/6+WSVMWzc5YYhg+EbZ0iUNr7HCK+glYRgYaTtTB0GabI5QPZwmVJZX9EDw==',key_name='tempest-TestShelveInstance-287110248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b5b339310242ea8837a4a3ffee6532',ramdisk_id='',reservation_id='r-g6gjeea3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1188210100',owner_user_name='tempest-TestShelveInstance-1188210100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:19:22Z,user_data=None,user_id='0a68d5e2b8b64a289abf08bba42e1033',uuid=68bca729-db5f-4edd-9549-979c5b00e49b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converting VIF {"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG os_vif [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35f24afb-8f32-5cbf-87a4-b360018d8062', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a833ede-1e, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a833ede-1e, col_values=(('qos', UUID('99092bef-4a66-4712-8eb4-c6dd44e23be1')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a833ede-1e, col_values=(('external_ids', {'iface-id': '7a833ede-1eff-4e41-89ff-72ecc27b25bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:eb:ca', 'vm-uuid': '68bca729-db5f-4edd-9549-979c5b00e49b'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:19:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:27 user nova-compute[75255]: INFO os_vif [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e')
Nov 14 11:19:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:19:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] No VIF found with MAC fa:16:3e:a4:eb:ca, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-c0bb9a45-6083-4436-9bf4-db9589bc8427 req-2bf7ecbc-39f0-4f6f-950c-b471503bac18 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c0bb9a45-6083-4436-9bf4-db9589bc8427 req-2bf7ecbc-39f0-4f6f-950c-b471503bac18 service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c0bb9a45-6083-4436-9bf4-db9589bc8427 req-2bf7ecbc-39f0-4f6f-950c-b471503bac18 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c0bb9a45-6083-4436-9bf4-db9589bc8427 req-2bf7ecbc-39f0-4f6f-950c-b471503bac18 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-c0bb9a45-6083-4436-9bf4-db9589bc8427 req-2bf7ecbc-39f0-4f6f-950c-b471503bac18 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:29 user nova-compute[75255]: WARNING nova.compute.manager [req-c0bb9a45-6083-4436-9bf4-db9589bc8427 req-2bf7ecbc-39f0-4f6f-950c-b471503bac18 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received unexpected event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with vm_state building and task_state spawning.
Nov 14 11:19:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:19:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance spawned successfully.
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:19:31 user nova-compute[75255]: INFO nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-b105d9b7-64b9-46c1-b521-7c1724a1ef3f req-ab4922dd-2f4f-452c-9420-21dc1ae188e5 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b105d9b7-64b9-46c1-b521-7c1724a1ef3f req-ab4922dd-2f4f-452c-9420-21dc1ae188e5 service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b105d9b7-64b9-46c1-b521-7c1724a1ef3f req-ab4922dd-2f4f-452c-9420-21dc1ae188e5 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b105d9b7-64b9-46c1-b521-7c1724a1ef3f req-ab4922dd-2f4f-452c-9420-21dc1ae188e5 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-b105d9b7-64b9-46c1-b521-7c1724a1ef3f req-ab4922dd-2f4f-452c-9420-21dc1ae188e5 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:31 user nova-compute[75255]: WARNING nova.compute.manager [req-b105d9b7-64b9-46c1-b521-7c1724a1ef3f req-ab4922dd-2f4f-452c-9420-21dc1ae188e5 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received unexpected event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with vm_state building and task_state spawning.
Nov 14 11:19:31 user nova-compute[75255]: INFO nova.compute.manager [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Took 10.33 seconds to build instance.
Nov 14 11:19:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d31fc789-8e02-4d0a-84dd-43a68d8ffd86 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.440s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:35 user nova-compute[75255]: INFO nova.compute.manager [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Terminating instance
Nov 14 11:19:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-1407f4d3-8777-4f99-8630-8f56254906ee req-33484765-db15-487b-95ce-79e8586da665 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received event network-vif-unplugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1407f4d3-8777-4f99-8630-8f56254906ee req-33484765-db15-487b-95ce-79e8586da665 service nova] Acquiring lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1407f4d3-8777-4f99-8630-8f56254906ee req-33484765-db15-487b-95ce-79e8586da665 service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1407f4d3-8777-4f99-8630-8f56254906ee req-33484765-db15-487b-95ce-79e8586da665 service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-1407f4d3-8777-4f99-8630-8f56254906ee req-33484765-db15-487b-95ce-79e8586da665 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] No waiting events found dispatching network-vif-unplugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-1407f4d3-8777-4f99-8630-8f56254906ee req-33484765-db15-487b-95ce-79e8586da665 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received event network-vif-unplugged-2550a711-fd0a-4f2c-875c-33e4593d1eca for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:19:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Instance destroyed successfully.
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lazy-loading 'resources' on Instance uuid 5da8ee6f-27ab-4f39-914d-d2b277f913b9 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-527643866',display_name='tempest-VolumesActionsTest-instance-527643866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-527643866',id=28,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='feb2db5b35b344b4a0f939695dda98ec',ramdisk_id='',reservation_id='r-3ejdogmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1934295409',owner_user_name='tempest-VolumesActionsTest-1934295409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:17:50Z,user_data=None,user_id='51df3343a8524c14ac4788217825a99f',uuid=5da8ee6f-27ab-4f39-914d-d2b277f913b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converting VIF {"id": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "address": "fa:16:3e:6e:ba:a1", "network": {"id": "b6d44f0f-6122-49ac-9745-5d23e2bcc78d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463745500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feb2db5b35b344b4a0f939695dda98ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2550a711-fd", "ovs_interfaceid": "2550a711-fd0a-4f2c-875c-33e4593d1eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ba:a1,bridge_name='br-int',has_traffic_filtering=True,id=2550a711-fd0a-4f2c-875c-33e4593d1eca,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2550a711-fd') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG os_vif [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ba:a1,bridge_name='br-int',has_traffic_filtering=True,id=2550a711-fd0a-4f2c-875c-33e4593d1eca,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2550a711-fd') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2550a711-fd, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54468d2f-25db-4d4f-862e-ec1154d6797f) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:36 user nova-compute[75255]: INFO os_vif [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ba:a1,bridge_name='br-int',has_traffic_filtering=True,id=2550a711-fd0a-4f2c-875c-33e4593d1eca,network=Network(b6d44f0f-6122-49ac-9745-5d23e2bcc78d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2550a711-fd')
Nov 14 11:19:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Deleting instance files /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9_del
Nov 14 11:19:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Deletion of /opt/stack/data/nova/instances/5da8ee6f-27ab-4f39-914d-d2b277f913b9_del complete
Nov 14 11:19:36 user nova-compute[75255]: INFO nova.compute.manager [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-350795a8-7148-4da4-afe5-b110b1594a77 req-ac3fe1f9-67fe-4a1b-99d8-b280f77d05f4 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received event network-vif-deleted-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:36 user nova-compute[75255]: INFO nova.compute.manager [req-350795a8-7148-4da4-afe5-b110b1594a77 req-ac3fe1f9-67fe-4a1b-99d8-b280f77d05f4 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Neutron deleted interface 2550a711-fd0a-4f2c-875c-33e4593d1eca; detaching it from the instance and deleting it from the info cache
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.network.neutron [req-350795a8-7148-4da4-afe5-b110b1594a77 req-ac3fe1f9-67fe-4a1b-99d8-b280f77d05f4 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-350795a8-7148-4da4-afe5-b110b1594a77 req-ac3fe1f9-67fe-4a1b-99d8-b280f77d05f4 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Detach interface failed, port_id=2550a711-fd0a-4f2c-875c-33e4593d1eca, reason: Instance 5da8ee6f-27ab-4f39-914d-d2b277f913b9 could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:19:36 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Took 0.52 seconds to deallocate network for instance.
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-d9efef28-61bd-4891-a8aa-df528818578d req-2e57eef3-7302-4e99-9957-4d43f407d734 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received event network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d9efef28-61bd-4891-a8aa-df528818578d req-2e57eef3-7302-4e99-9957-4d43f407d734 service nova] Acquiring lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d9efef28-61bd-4891-a8aa-df528818578d req-2e57eef3-7302-4e99-9957-4d43f407d734 service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d9efef28-61bd-4891-a8aa-df528818578d req-2e57eef3-7302-4e99-9957-4d43f407d734 service nova] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-d9efef28-61bd-4891-a8aa-df528818578d req-2e57eef3-7302-4e99-9957-4d43f407d734 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] No waiting events found dispatching network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:37 user nova-compute[75255]: WARNING nova.compute.manager [req-d9efef28-61bd-4891-a8aa-df528818578d req-2e57eef3-7302-4e99-9957-4d43f407d734 service nova] [instance: 5da8ee6f-27ab-4f39-914d-d2b277f913b9] Received unexpected event network-vif-plugged-2550a711-fd0a-4f2c-875c-33e4593d1eca for instance with vm_state deleted and task_state None.
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.848s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:19:37 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7825MB free_disk=25.074176788330078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:37 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Deleted allocations for instance 5da8ee6f-27ab-4f39-914d-d2b277f913b9
Nov 14 11:19:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6dbadf6b-1136-4728-8728-19503b151e33 tempest-VolumesActionsTest-1934295409 tempest-VolumesActionsTest-1934295409-project-member] Lock "5da8ee6f-27ab-4f39-914d-d2b277f913b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9057f65e-8951-49ad-963c-a62d9a8a1724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 69fe826e-b67c-4109-914d-94c04d09a216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 68bca729-db5f-4edd-9549-979c5b00e49b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:19:37 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:19:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:19:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:19:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:19:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:19:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:42 user nova-compute[75255]: INFO nova.compute.manager [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Terminating instance
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.compute.manager [req-0d7fe2ee-4ab0-48af-be41-c2f388cbe7f3 req-5858b95a-8648-4e79-8206-dc1911488211 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-unplugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0d7fe2ee-4ab0-48af-be41-c2f388cbe7f3 req-5858b95a-8648-4e79-8206-dc1911488211 service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0d7fe2ee-4ab0-48af-be41-c2f388cbe7f3 req-5858b95a-8648-4e79-8206-dc1911488211 service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0d7fe2ee-4ab0-48af-be41-c2f388cbe7f3 req-5858b95a-8648-4e79-8206-dc1911488211 service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.compute.manager [req-0d7fe2ee-4ab0-48af-be41-c2f388cbe7f3 req-5858b95a-8648-4e79-8206-dc1911488211 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-unplugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.compute.manager [req-0d7fe2ee-4ab0-48af-be41-c2f388cbe7f3 req-5858b95a-8648-4e79-8206-dc1911488211 service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-unplugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Instance destroyed successfully.
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.objects.instance [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lazy-loading 'resources' on Instance uuid 69fe826e-b67c-4109-914d-94c04d09a216 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1394251709',display_name='tempest-AttachVolumeNegativeTest-server-1394251709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1394251709',id=27,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8m2JXsbQr01ZeLqju51q9SUJDLADovxJZoE81uReTfiF9LQfAdAzDhIGGiAIipIoWhJl37vC/lFu8Kz0RMQppWwwBh+IHzu7IHxn8wa6jPEw1Xy9+6THMteTj+iNtSzA==',key_name='tempest-keypair-2055220250',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524a841af9524bd98f64657594598808',ramdisk_id='',reservation_id='r-n15disza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1930109654',owner_user_name='tempest-AttachVolumeNegativeTest-1930109654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501c5fe846ca4bfeacc413c97911f8f6',uuid=69fe826e-b67c-4109-914d-94c04d09a216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converting VIF {"id": "aea1359b-9af0-4ab0-b694-533c76eaea02", "address": "fa:16:3e:7d:03:9d", "network": {"id": "3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-680674769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524a841af9524bd98f64657594598808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea1359b-9a", "ovs_interfaceid": "aea1359b-9af0-4ab0-b694-533c76eaea02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:03:9d,bridge_name='br-int',has_traffic_filtering=True,id=aea1359b-9af0-4ab0-b694-533c76eaea02,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea1359b-9a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG os_vif [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:03:9d,bridge_name='br-int',has_traffic_filtering=True,id=aea1359b-9af0-4ab0-b694-533c76eaea02,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea1359b-9a') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaea1359b-9a, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=750c1890-3f83-4c22-8eea-39bffe5fe4d3) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:19:42 user nova-compute[75255]: INFO os_vif [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:03:9d,bridge_name='br-int',has_traffic_filtering=True,id=aea1359b-9af0-4ab0-b694-533c76eaea02,network=Network(3bc2b1f6-1b32-4b0d-9a4b-4a09327d3d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea1359b-9a')
Nov 14 11:19:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Deleting instance files /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216_del
Nov 14 11:19:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Deletion of /opt/stack/data/nova/instances/69fe826e-b67c-4109-914d-94c04d09a216_del complete
Nov 14 11:19:43 user nova-compute[75255]: INFO nova.compute.manager [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 11:19:43 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-1906b555-810e-449b-98f9-dfec9e2799e4 req-ec884230-94d4-4b4b-af83-2f375af6927b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-deleted-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:43 user nova-compute[75255]: INFO nova.compute.manager [req-1906b555-810e-449b-98f9-dfec9e2799e4 req-ec884230-94d4-4b4b-af83-2f375af6927b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Neutron deleted interface aea1359b-9af0-4ab0-b694-533c76eaea02; detaching it from the instance and deleting it from the info cache
Nov 14 11:19:43 user nova-compute[75255]: DEBUG nova.network.neutron [req-1906b555-810e-449b-98f9-dfec9e2799e4 req-ec884230-94d4-4b4b-af83-2f375af6927b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:43 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Took 0.81 seconds to deallocate network for instance.
Nov 14 11:19:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-1906b555-810e-449b-98f9-dfec9e2799e4 req-ec884230-94d4-4b4b-af83-2f375af6927b service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Detach interface failed, port_id=aea1359b-9af0-4ab0-b694-533c76eaea02, reason: Instance 69fe826e-b67c-4109-914d-94c04d09a216 could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:44 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Deleted allocations for instance 69fe826e-b67c-4109-914d-94c04d09a216
Nov 14 11:19:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-15419d0e-64f2-4dd0-9d27-3ee0c1f7ce38 tempest-AttachVolumeNegativeTest-1930109654 tempest-AttachVolumeNegativeTest-1930109654-project-member] Lock "69fe826e-b67c-4109-914d-94c04d09a216" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:44 user nova-compute[75255]: WARNING nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received unexpected event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with vm_state deleted and task_state None.
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:44 user nova-compute[75255]: WARNING nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received unexpected event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with vm_state deleted and task_state None.
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:44 user nova-compute[75255]: WARNING nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received unexpected event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with vm_state deleted and task_state None.
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-unplugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-unplugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:44 user nova-compute[75255]: WARNING nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received unexpected event network-vif-unplugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with vm_state deleted and task_state None.
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Acquiring lock "69fe826e-b67c-4109-914d-94c04d09a216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] Lock "69fe826e-b67c-4109-914d-94c04d09a216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] No waiting events found dispatching network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:44 user nova-compute[75255]: WARNING nova.compute.manager [req-d58eeb64-24ce-4310-b830-1071ca0071e3 req-fa4b205a-fc7c-4dca-b19e-5985ec8f02bd service nova] [instance: 69fe826e-b67c-4109-914d-94c04d09a216] Received unexpected event network-vif-plugged-aea1359b-9af0-4ab0-b694-533c76eaea02 for instance with vm_state deleted and task_state None.
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updating instance_info_cache with network_info: [{"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-66031f17-4225-4c50-bd18-3df496586023" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:19:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:19:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'flavor' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:50 user nova-compute[75255]: INFO nova.compute.manager [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Attaching volume 95a2ab19-def6-4aa7-b2a5-d213b16e1a7d to /dev/vdb
Nov 14 11:19:50 user nova-compute[75255]: DEBUG os_brick.utils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29a7571-54f7-4c92-baf6-804b5786a3dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[723ba70e-ea76-4c3b-af12-f56283f8ecd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc27df7-756a-47a8-ab55-d9381d8346fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[62659ecf-ed64-43ac-b453-e0eff4c90600]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:19:51 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:19:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59a4ce6-1afc-42b7-ab86-00aa9dfdc8bc]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG os_brick.utils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:19:51 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating existing volume attachment record: 6d0e24d1-ed03-4d8f-bed5-a710a1ab4de1 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:19:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuPiRkpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:19:55 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:19:55 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:19:55 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841d552-0f36-49fe-9de7-77fadff9c5df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:19:55 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccae1460-93cf-47eb-be77-a6494ac22341]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d] added
Nov 14 11:19:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec1022-d3af-4fd3-8877-8597f8b25137]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedae562-3c77-4942-bd04-f904418a1920]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuPiRkpG {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuPiRkpG" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[81484dcb-960d-486d-a9e4-508b502a9cfc]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XuPiRkpG'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0b2a2f-6c11-4d4a-a152-d74ebb6c0e54]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c360a35-1d7c-4805-94d8-4312b5254819]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:19:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:19:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ae952-5b79-4959-8d01-335f64220c4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260]
Nov 14 11:19:55 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260] successful.
Nov 14 11:19:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff734d69-128f-4079-b28b-b25426937e48]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f9e666-b0db-4a95-ada5-ed9d4b911ccc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:19:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:19:55 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:19:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d623cb-2492-4c76-817d-7022fcffabe2]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:19:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuPiRkpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:19:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:19:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23831646137373663', 'path': '/dev/sdf'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:19:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831646137373663', 'path': '/dev/sdf'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:19:56 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'flavor' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:19:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:19:56 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:19:56 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:19:56 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:19:56 user nova-compute[75255]:   <serial>95a2ab19-def6-4aa7-b2a5-d213b16e1a7d</serial>
Nov 14 11:19:56 user nova-compute[75255]: </disk>
Nov 14 11:19:56 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:19:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:19:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:19:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No VIF found with MAC fa:16:3e:d0:5f:5a, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:19:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f9e65a0-4463-4761-a357-975c87dfe242 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.404s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:57 user nova-compute[75255]: INFO nova.compute.manager [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Rescuing
Nov 14 11:19:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:19:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquired lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:19:57 user nova-compute[75255]: DEBUG nova.network.neutron [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:19:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Releasing lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-7ac23fc1-2a52-4a9c-9af8-b4e21967c2c9 req-c2a82267-c3f1-44cc-a12c-c6c27556bfe9 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ac23fc1-2a52-4a9c-9af8-b4e21967c2c9 req-c2a82267-c3f1-44cc-a12c-c6c27556bfe9 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ac23fc1-2a52-4a9c-9af8-b4e21967c2c9 req-c2a82267-c3f1-44cc-a12c-c6c27556bfe9 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ac23fc1-2a52-4a9c-9af8-b4e21967c2c9 req-c2a82267-c3f1-44cc-a12c-c6c27556bfe9 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-7ac23fc1-2a52-4a9c-9af8-b4e21967c2c9 req-c2a82267-c3f1-44cc-a12c-c6c27556bfe9 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:19:58 user nova-compute[75255]: WARNING nova.compute.manager [req-7ac23fc1-2a52-4a9c-9af8-b4e21967c2c9 req-c2a82267-c3f1-44cc-a12c-c6c27556bfe9 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state active and task_state rescuing.
Nov 14 11:19:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance destroyed successfully.
Nov 14 11:19:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Attempting a stable device rescue
Nov 14 11:19:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75255) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:19:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Creating image(s)
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'trusted_certs' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "49b0892d73b181f82de6eb4631148f55e06857a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:19:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "49b0892d73b181f82de6eb4631148f55e06857a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.part --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG nova.virt.images [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] c6e91afd-5332-487a-a071-43835572d3d6 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.part /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-b9fc8dbc-b103-4aa6-b771-1d22c995de84 req-1164516f-0d48-4dfc-8465-daabb46ce9b6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9fc8dbc-b103-4aa6-b771-1d22c995de84 req-1164516f-0d48-4dfc-8465-daabb46ce9b6 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9fc8dbc-b103-4aa6-b771-1d22c995de84 req-1164516f-0d48-4dfc-8465-daabb46ce9b6 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9fc8dbc-b103-4aa6-b771-1d22c995de84 req-1164516f-0d48-4dfc-8465-daabb46ce9b6 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-b9fc8dbc-b103-4aa6-b771-1d22c995de84 req-1164516f-0d48-4dfc-8465-daabb46ce9b6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:20:00 user nova-compute[75255]: WARNING nova.compute.manager [req-b9fc8dbc-b103-4aa6-b771-1d22c995de84 req-1164516f-0d48-4dfc-8465-daabb46ce9b6 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state active and task_state rescuing.
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.part /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.converted" returned: 0 in 0.488s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "49b0892d73b181f82de6eb4631148f55e06857a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.974s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "49b0892d73b181f82de6eb4631148f55e06857a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "49b0892d73b181f82de6eb4631148f55e06857a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0 --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0,backing_fmt=raw /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0,backing_fmt=raw /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue" returned: 0 in 0.059s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "49b0892d73b181f82de6eb4631148f55e06857a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'migration_context' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Object Instance<ddc1e1f7-468c-411d-8406-4f22bf7b457b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Start _get_guest_xml network_info=[{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "vif_mac": "fa:16:3e:d0:5f:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c6e91afd-5332-487a-a071-43835572d3d6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '6d0e24d1-ed03-4d8f-bed5-a710a1ab4de1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuPiRkpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ddc1e1f7-468c-411d-8406-4f22bf7b457b', 'attached_at': '', 'detached_at': '', 'volume_id': '95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 'serial': '95a2ab19-def6-4aa7-b2a5-d213b16e1a7d'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'resources' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Object Instance<ddc1e1f7-468c-411d-8406-4f22bf7b457b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'numa_topology' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Object Instance<ddc1e1f7-468c-411d-8406-4f22bf7b457b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:20:01 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:20:01 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'vcpu_model' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Object Instance<ddc1e1f7-468c-411d-8406-4f22bf7b457b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuPiRkpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:20:01 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:20:01 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:20:01 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c33a13-ee7f-45be-84ec-bd943361ce5d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XuPiRkpG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 11:20:01 user nova-compute[75255]: node.name = iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d
Nov 14 11:20:01 user nova-compute[75255]: node.tpgt = -1
Nov 14 11:20:01 user nova-compute[75255]: node.startup = automatic
Nov 14 11:20:01 user nova-compute[75255]: node.leading_login = No
Nov 14 11:20:01 user nova-compute[75255]: iface.iscsi_ifacename = default
Nov 14 11:20:01 user nova-compute[75255]: iface.net_ifacename = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.ipaddress = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.prefix_len = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.hwaddress = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.transport_name = tcp
Nov 14 11:20:01 user nova-compute[75255]: iface.initiatorname = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.state = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.vlan_id = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.vlan_priority = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.vlan_state = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.iface_num = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.mtu = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.port = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.bootproto = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.subnet_mask = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.gateway = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_alt_client_id = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_dns = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_learn_iqn = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_vendor_id_state = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_vendor_id = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.dhcp_slp_da = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.fragmentation = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.gratuitous_arp = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.incoming_forwarding = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.tos_state = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.tos = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.ttl = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.delayed_ack = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.tcp_nagle = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.tcp_wsf_state = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.tcp_wsf = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.tcp_timer_scale = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.tcp_timestamp = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.redirect = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.def_task_mgmt_timeout = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.header_digest = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.data_digest = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.immediate_data = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.initial_r2t = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.data_seq_inorder = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.data_pdu_inorder = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.erl = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.max_receive_data_len = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.first_burst_len = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.max_outstanding_r2t = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.max_burst_len = 0
Nov 14 11:20:01 user nova-compute[75255]: iface.chap_auth = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.bidi_chap = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.strict_login_compliance = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.discovery_auth = <empty>
Nov 14 11:20:01 user nova-compute[75255]: iface.discovery_logout = <empty>
Nov 14 11:20:01 user nova-compute[75255]: node.discovery_address = <empty>
Nov 14 11:20:01 user nova-compute[75255]: node.discovery_port = 0
Nov 14 11:20:01 user nova-compute[75255]: node.discovery_type = static
Nov 14 11:20:01 user nova-compute[75255]: node.session.initial_cmdsn = 0
Nov 14 11:20:01 user nova-compute[75255]: node.session.initial_login_retry_max = 8
Nov 14 11:20:01 user nova-compute[75255]: node.session.xmit_thread_priority = -20
Nov 14 11:20:01 user nova-compute[75255]: node.session.cmds_max = 128
Nov 14 11:20:01 user nova-compute[75255]: node.session.queue_depth = 32
Nov 14 11:20:01 user nova-compute[75255]: node.session.nr_sessions = 1
Nov 14 11:20:01 user nova-compute[75255]: node.session.auth.authmethod = CHAP
Nov 14 11:20:01 user nova-compute[75255]: node.session.auth.username = XuPiRkpG
Nov 14 11:20:01 user nova-compute[75255]: node.session.auth.password = ***
Nov 14 11:20:01 user nova-compute[75255]: node.session.auth.username_in = <empty>
Nov 14 11:20:01 user nova-compute[75255]: node.session.auth.password_in = <empty>
Nov 14 11:20:01 user nova-compute[75255]: node.session.auth.chap_algs = MD5
Nov 14 11:20:01 user nova-compute[75255]: node.session.timeo.replacement_timeout = 120
Nov 14 11:20:01 user nova-compute[75255]: node.session.err_timeo.abort_timeout = 15
Nov 14 11:20:01 user nova-compute[75255]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 11:20:01 user nova-compute[75255]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 11:20:01 user nova-compute[75255]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.FastAbort = Yes
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.InitialR2T = No
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.ImmediateData = Yes
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.MaxConnections = 1
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 11:20:01 user nova-compute[75255]: node.session.iscsi.ERL = 0
Nov 14 11:20:01 user nova-compute[75255]: node.session.scan = manual
Nov 14 11:20:01 user nova-compute[75255]: node.session.reopen_max = 0
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].address = 172.16.0.220
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].port = 3260
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].startup = manual
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].tcp.window_size = 524288
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].tcp.type_of_service = 0
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].timeo.logout_timeout = 15
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].timeo.login_timeout = 15
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].timeo.auth_timeout = 45
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].iscsi.DataDigest = None
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].iscsi.IFMarker = No
Nov 14 11:20:01 user nova-compute[75255]: node.conn[0].iscsi.OFMarker = No
Nov 14 11:20:01 user nova-compute[75255]: # END RECORD
Nov 14 11:20:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8808aea5-981b-41d2-aaba-37e9925576d9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9878ba-93fb-47de-8e22-9735c84166cb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuPiRkpG {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuPiRkpG" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7999a0-5a86-4787-b4b0-8b0df6ffcb58]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XuPiRkpG'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[53698dce-4e35-4abd-a459-09a3cfde67e8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74a586f-5f45-4d00-acd7-8b5b50387f79]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:20:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:20:01 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:20:01 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] HCTL ('37', '0', '0', 0) found on session 34 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedac0ed-de53-419d-819c-8c34f8da241b]: (4, ('0 0 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Searching for a device in session 34 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuPiRkpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23831646137373663', 'path': '/dev/sdf'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831646137373663', 'path': '/dev/sdf'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-893880233',display_name='tempest-ServerStableDeviceRescueTest-server-893880233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-893880233',id=26,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvjm3mfZ3A1nuCZmbZ6DHT/v2SGbBbRTQ3rTSIMUmz2mJmOvLPnIXv0X38Y8d6CK5rqaKiD1dGcVRZtgMtuEvRpU8NWVcWg1sDGBjTB9suOOCGfZl5rX+FZPbfuqYw4Mw==',key_name='tempest-keypair-1355669994',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49a5377fc1334955bebb27aeeecdcdff',ramdisk_id='',reservation_id='r-d424vfs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-686352298',owner_user_name='tempest-ServerStableDeviceRescueTest-686352298-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7197d75a463840b38c24f31bda6b5ea2',uuid=ddc1e1f7-468c-411d-8406-4f22bf7b457b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "vif_mac": "fa:16:3e:d0:5f:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converting VIF {"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "vif_mac": "fa:16:3e:d0:5f:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.objects.base [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Object Instance<ddc1e1f7-468c-411d-8406-4f22bf7b457b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:20:01 user nova-compute[75255]:   <uuid>ddc1e1f7-468c-411d-8406-4f22bf7b457b</uuid>
Nov 14 11:20:01 user nova-compute[75255]:   <name>instance-0000001a</name>
Nov 14 11:20:01 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:20:01 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:20:01 user nova-compute[75255]:   <metadata>
Nov 14 11:20:01 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:20:01 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:20:01 user nova-compute[75255]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-893880233</nova:name>
Nov 14 11:20:01 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:20:01</nova:creationTime>
Nov 14 11:20:01 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:20:01 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:20:01 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:20:01 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:20:01 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:20:01 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:20:01 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:20:01 user nova-compute[75255]:       <nova:owner>
Nov 14 11:20:01 user nova-compute[75255]:         <nova:user uuid="7197d75a463840b38c24f31bda6b5ea2">tempest-ServerStableDeviceRescueTest-686352298-project-member</nova:user>
Nov 14 11:20:01 user nova-compute[75255]:         <nova:project uuid="49a5377fc1334955bebb27aeeecdcdff">tempest-ServerStableDeviceRescueTest-686352298</nova:project>
Nov 14 11:20:01 user nova-compute[75255]:       </nova:owner>
Nov 14 11:20:01 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:20:01 user nova-compute[75255]:       <nova:ports>
Nov 14 11:20:01 user nova-compute[75255]:         <nova:port uuid="7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3">
Nov 14 11:20:01 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:20:01 user nova-compute[75255]:         </nova:port>
Nov 14 11:20:01 user nova-compute[75255]:       </nova:ports>
Nov 14 11:20:01 user nova-compute[75255]:     </nova:instance>
Nov 14 11:20:01 user nova-compute[75255]:   </metadata>
Nov 14 11:20:01 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:20:01 user nova-compute[75255]:     <system>
Nov 14 11:20:01 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:20:01 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:20:01 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:20:01 user nova-compute[75255]:       <entry name="serial">ddc1e1f7-468c-411d-8406-4f22bf7b457b</entry>
Nov 14 11:20:01 user nova-compute[75255]:       <entry name="uuid">ddc1e1f7-468c-411d-8406-4f22bf7b457b</entry>
Nov 14 11:20:01 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:20:01 user nova-compute[75255]:     </system>
Nov 14 11:20:01 user nova-compute[75255]:   </sysinfo>
Nov 14 11:20:01 user nova-compute[75255]:   <os>
Nov 14 11:20:01 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:20:01 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:20:01 user nova-compute[75255]:   </os>
Nov 14 11:20:01 user nova-compute[75255]:   <features>
Nov 14 11:20:01 user nova-compute[75255]:     <acpi/>
Nov 14 11:20:01 user nova-compute[75255]:     <apic/>
Nov 14 11:20:01 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:20:01 user nova-compute[75255]:   </features>
Nov 14 11:20:01 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:20:01 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:20:01 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:20:01 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:20:01 user nova-compute[75255]:   </clock>
Nov 14 11:20:01 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:20:01 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:20:01 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:20:01 user nova-compute[75255]:   </cpu>
Nov 14 11:20:01 user nova-compute[75255]:   <devices>
Nov 14 11:20:01 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:20:01 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:20:01 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk"/>
Nov 14 11:20:01 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:20:01 user nova-compute[75255]:     </disk>
Nov 14 11:20:01 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:20:01 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:20:01 user nova-compute[75255]:       <source dev="/dev/sdf"/>
Nov 14 11:20:01 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:20:01 user nova-compute[75255]:       <serial>95a2ab19-def6-4aa7-b2a5-d213b16e1a7d</serial>
Nov 14 11:20:01 user nova-compute[75255]:     </disk>
Nov 14 11:20:01 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:20:01 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:20:01 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue"/>
Nov 14 11:20:01 user nova-compute[75255]:       <target dev="vdc" bus="virtio"/>
Nov 14 11:20:01 user nova-compute[75255]:       <boot order="1"/>
Nov 14 11:20:01 user nova-compute[75255]:     </disk>
Nov 14 11:20:01 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:20:01 user nova-compute[75255]:       <mac address="fa:16:3e:d0:5f:5a"/>
Nov 14 11:20:01 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:20:01 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:20:01 user nova-compute[75255]:       <target dev="tap7ff2a1b6-c7"/>
Nov 14 11:20:01 user nova-compute[75255]:     </interface>
Nov 14 11:20:01 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:20:01 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/console.log" append="off"/>
Nov 14 11:20:01 user nova-compute[75255]:     </serial>
Nov 14 11:20:01 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:20:01 user nova-compute[75255]:     <video>
Nov 14 11:20:01 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:20:01 user nova-compute[75255]:     </video>
Nov 14 11:20:01 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:20:01 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:20:01 user nova-compute[75255]:     </rng>
Nov 14 11:20:01 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:20:01 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:20:01 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:20:01 user nova-compute[75255]:     </memballoon>
Nov 14 11:20:01 user nova-compute[75255]:   </devices>
Nov 14 11:20:01 user nova-compute[75255]: </domain>
Nov 14 11:20:01 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:20:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance destroyed successfully.
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:20:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] No VIF found with MAC fa:16:3e:d0:5f:5a, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:20:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-4e61b3be-8dfe-47fc-9016-a744d9e8ff7d req-89995a51-4d9e-4791-a616-6ef620af6769 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e61b3be-8dfe-47fc-9016-a744d9e8ff7d req-89995a51-4d9e-4791-a616-6ef620af6769 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e61b3be-8dfe-47fc-9016-a744d9e8ff7d req-89995a51-4d9e-4791-a616-6ef620af6769 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4e61b3be-8dfe-47fc-9016-a744d9e8ff7d req-89995a51-4d9e-4791-a616-6ef620af6769 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-4e61b3be-8dfe-47fc-9016-a744d9e8ff7d req-89995a51-4d9e-4791-a616-6ef620af6769 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:20:03 user nova-compute[75255]: WARNING nova.compute.manager [req-4e61b3be-8dfe-47fc-9016-a744d9e8ff7d req-89995a51-4d9e-4791-a616-6ef620af6769 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state active and task_state rescuing.
Nov 14 11:20:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "2bb9fe90-561b-4cf2-a657-756594130121" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:20:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:20:04 user nova-compute[75255]: INFO nova.compute.claims [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Claim successful on node user
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-bdf0cad1-f5f0-4d15-9c9b-9781d198d5a5 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-416ca64a-b25b-4d58-a6e4-f4f2f5f74f23 req-8d444460-93b6-4379-8360-b8080ad80b15 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-416ca64a-b25b-4d58-a6e4-f4f2f5f74f23 req-8d444460-93b6-4379-8360-b8080ad80b15 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-416ca64a-b25b-4d58-a6e4-f4f2f5f74f23 req-8d444460-93b6-4379-8360-b8080ad80b15 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-416ca64a-b25b-4d58-a6e4-f4f2f5f74f23 req-8d444460-93b6-4379-8360-b8080ad80b15 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-416ca64a-b25b-4d58-a6e4-f4f2f5f74f23 req-8d444460-93b6-4379-8360-b8080ad80b15 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:20:05 user nova-compute[75255]: WARNING nova.compute.manager [req-416ca64a-b25b-4d58-a6e4-f4f2f5f74f23 req-8d444460-93b6-4379-8360-b8080ad80b15 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state rescued and task_state None.
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:20:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.policy [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b82af4602b649889188f0f943c63896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb07eaf3ea24939aeef6eba1bb2293d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:20:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Creating image(s)
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk 1073741824" returned: 0 in 0.052s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Successfully created port: e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Cannot resize image /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Ensure instance console log exists: /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Successfully updated port: e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received event network-changed-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Refreshing instance network info cache due to event network-changed-e610c225-9b38-4ad3-b93d-c98e43c5b6b0. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] Acquiring lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Updating instance_info_cache with network_info: [{"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Instance network_info: |[{"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] Acquired lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:20:06 user nova-compute[75255]: DEBUG nova.network.neutron [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Refreshing network info cache for port e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Start _get_guest_xml network_info=[{"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:20:07 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:20:07 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944719245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944719245',id=30,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-xef3b5k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:20:05Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=2bb9fe90-561b-4cf2-a657-756594130121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=e610c225-9b38-4ad3-b93d-c98e43c5b6b0,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape610c225-9b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb9fe90-561b-4cf2-a657-756594130121 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:20:07 user nova-compute[75255]:   <uuid>2bb9fe90-561b-4cf2-a657-756594130121</uuid>
Nov 14 11:20:07 user nova-compute[75255]:   <name>instance-0000001e</name>
Nov 14 11:20:07 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:20:07 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:20:07 user nova-compute[75255]:   <metadata>
Nov 14 11:20:07 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:20:07 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:20:07 user nova-compute[75255]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1944719245</nova:name>
Nov 14 11:20:07 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:20:07</nova:creationTime>
Nov 14 11:20:07 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:20:07 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:20:07 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:20:07 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:20:07 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:20:07 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:20:07 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:20:07 user nova-compute[75255]:       <nova:owner>
Nov 14 11:20:07 user nova-compute[75255]:         <nova:user uuid="3b82af4602b649889188f0f943c63896">tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member</nova:user>
Nov 14 11:20:07 user nova-compute[75255]:         <nova:project uuid="bbb07eaf3ea24939aeef6eba1bb2293d">tempest-ServerBootFromVolumeStableRescueTest-1912178200</nova:project>
Nov 14 11:20:07 user nova-compute[75255]:       </nova:owner>
Nov 14 11:20:07 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:20:07 user nova-compute[75255]:       <nova:ports>
Nov 14 11:20:07 user nova-compute[75255]:         <nova:port uuid="e610c225-9b38-4ad3-b93d-c98e43c5b6b0">
Nov 14 11:20:07 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 11:20:07 user nova-compute[75255]:         </nova:port>
Nov 14 11:20:07 user nova-compute[75255]:       </nova:ports>
Nov 14 11:20:07 user nova-compute[75255]:     </nova:instance>
Nov 14 11:20:07 user nova-compute[75255]:   </metadata>
Nov 14 11:20:07 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:20:07 user nova-compute[75255]:     <system>
Nov 14 11:20:07 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:20:07 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:20:07 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:20:07 user nova-compute[75255]:       <entry name="serial">2bb9fe90-561b-4cf2-a657-756594130121</entry>
Nov 14 11:20:07 user nova-compute[75255]:       <entry name="uuid">2bb9fe90-561b-4cf2-a657-756594130121</entry>
Nov 14 11:20:07 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:20:07 user nova-compute[75255]:     </system>
Nov 14 11:20:07 user nova-compute[75255]:   </sysinfo>
Nov 14 11:20:07 user nova-compute[75255]:   <os>
Nov 14 11:20:07 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:20:07 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:20:07 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:20:07 user nova-compute[75255]:   </os>
Nov 14 11:20:07 user nova-compute[75255]:   <features>
Nov 14 11:20:07 user nova-compute[75255]:     <acpi/>
Nov 14 11:20:07 user nova-compute[75255]:     <apic/>
Nov 14 11:20:07 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:20:07 user nova-compute[75255]:   </features>
Nov 14 11:20:07 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:20:07 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:20:07 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:20:07 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:20:07 user nova-compute[75255]:   </clock>
Nov 14 11:20:07 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:20:07 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:20:07 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:20:07 user nova-compute[75255]:   </cpu>
Nov 14 11:20:07 user nova-compute[75255]:   <devices>
Nov 14 11:20:07 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:20:07 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:20:07 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk"/>
Nov 14 11:20:07 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:20:07 user nova-compute[75255]:     </disk>
Nov 14 11:20:07 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:20:07 user nova-compute[75255]:       <mac address="fa:16:3e:62:bb:24"/>
Nov 14 11:20:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:20:07 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:20:07 user nova-compute[75255]:       <target dev="tape610c225-9b"/>
Nov 14 11:20:07 user nova-compute[75255]:     </interface>
Nov 14 11:20:07 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:20:07 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/console.log" append="off"/>
Nov 14 11:20:07 user nova-compute[75255]:     </serial>
Nov 14 11:20:07 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:20:07 user nova-compute[75255]:     <video>
Nov 14 11:20:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:20:07 user nova-compute[75255]:     </video>
Nov 14 11:20:07 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:20:07 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:20:07 user nova-compute[75255]:     </rng>
Nov 14 11:20:07 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:20:07 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:20:07 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:20:07 user nova-compute[75255]:     </memballoon>
Nov 14 11:20:07 user nova-compute[75255]:   </devices>
Nov 14 11:20:07 user nova-compute[75255]: </domain>
Nov 14 11:20:07 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944719245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944719245',id=30,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-xef3b5k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:20:05Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=2bb9fe90-561b-4cf2-a657-756594130121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=e610c225-9b38-4ad3-b93d-c98e43c5b6b0,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape610c225-9b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG os_vif [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=e610c225-9b38-4ad3-b93d-c98e43c5b6b0,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape610c225-9b') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77816710-c2a4-5317-8502-068291dd0e8b', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape610c225-9b, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape610c225-9b, col_values=(('qos', UUID('db18da38-a871-4ae7-b6ec-bb49e8333419')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape610c225-9b, col_values=(('external_ids', {'iface-id': 'e610c225-9b38-4ad3-b93d-c98e43c5b6b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:bb:24', 'vm-uuid': '2bb9fe90-561b-4cf2-a657-756594130121'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:07 user nova-compute[75255]: INFO os_vif [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=e610c225-9b38-4ad3-b93d-c98e43c5b6b0,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape610c225-9b')
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No VIF found with MAC fa:16:3e:62:bb:24, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Updated VIF entry in instance network info cache for port e610c225-9b38-4ad3-b93d-c98e43c5b6b0. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Updating instance_info_cache with network_info: [{"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:20:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-615fa6cb-587e-40c5-a9e8-1edd2cbdc41b req-767fbe1a-0a91-429f-b67c-9db23fec7bd3 service nova] Releasing lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-a3521cde-1f43-4cae-ab2c-266276c4835e req-b2a6dba9-cbdf-4aeb-b1bf-35d636a76de6 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received event network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a3521cde-1f43-4cae-ab2c-266276c4835e req-b2a6dba9-cbdf-4aeb-b1bf-35d636a76de6 service nova] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a3521cde-1f43-4cae-ab2c-266276c4835e req-b2a6dba9-cbdf-4aeb-b1bf-35d636a76de6 service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a3521cde-1f43-4cae-ab2c-266276c4835e req-b2a6dba9-cbdf-4aeb-b1bf-35d636a76de6 service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-a3521cde-1f43-4cae-ab2c-266276c4835e req-b2a6dba9-cbdf-4aeb-b1bf-35d636a76de6 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] No waiting events found dispatching network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:20:08 user nova-compute[75255]: WARNING nova.compute.manager [req-a3521cde-1f43-4cae-ab2c-266276c4835e req-b2a6dba9-cbdf-4aeb-b1bf-35d636a76de6 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received unexpected event network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 for instance with vm_state building and task_state spawning.
Nov 14 11:20:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:20:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Instance spawned successfully.
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-2dff1b4b-5845-429c-8158-31097f267ae9 req-b2707fb2-c907-498c-ba5b-edf707a20d91 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received event network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2dff1b4b-5845-429c-8158-31097f267ae9 req-b2707fb2-c907-498c-ba5b-edf707a20d91 service nova] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2dff1b4b-5845-429c-8158-31097f267ae9 req-b2707fb2-c907-498c-ba5b-edf707a20d91 service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2dff1b4b-5845-429c-8158-31097f267ae9 req-b2707fb2-c907-498c-ba5b-edf707a20d91 service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-2dff1b4b-5845-429c-8158-31097f267ae9 req-b2707fb2-c907-498c-ba5b-edf707a20d91 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] No waiting events found dispatching network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:20:10 user nova-compute[75255]: WARNING nova.compute.manager [req-2dff1b4b-5845-429c-8158-31097f267ae9 req-b2707fb2-c907-498c-ba5b-edf707a20d91 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received unexpected event network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 for instance with vm_state building and task_state spawning.
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:20:10 user nova-compute[75255]: INFO nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 11:20:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:20:10 user nova-compute[75255]: INFO nova.compute.manager [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Took 6.08 seconds to build instance.
Nov 14 11:20:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3a3f7278-fc74-43d1-acdd-58bd971a35da tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "2bb9fe90-561b-4cf2-a657-756594130121" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.210s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:13 user nova-compute[75255]: INFO nova.compute.manager [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Detaching volume ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3
Nov 14 11:20:13 user nova-compute[75255]: INFO nova.virt.block_device [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Attempting to driver detach volume ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 from mountpoint /dev/vdb
Nov 14 11:20:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Attempting to detach device vdb from instance 9057f65e-8951-49ad-963c-a62d9a8a1724 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:20:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:20:13 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:20:13 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:20:13 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:20:13 user nova-compute[75255]:   <serial>ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3</serial>
Nov 14 11:20:13 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:20:13 user nova-compute[75255]: </disk>
Nov 14 11:20:13 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:20:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully detached device vdb from instance 9057f65e-8951-49ad-963c-a62d9a8a1724 from the persistent domain config.
Nov 14 11:20:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9057f65e-8951-49ad-963c-a62d9a8a1724 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:20:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:20:13 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:20:13 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:20:13 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:20:13 user nova-compute[75255]:   <serial>ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3</serial>
Nov 14 11:20:13 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:20:13 user nova-compute[75255]: </disk>
Nov 14 11:20:13 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:20:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9057f65e-8951-49ad-963c-a62d9a8a1724 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:20:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:20:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:20:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:20:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:20:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:20:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:33 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9057f65e-8951-49ad-963c-a62d9a8a1724 is timed out.
Nov 14 11:20:33 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully detached device vdb from instance 9057f65e-8951-49ad-963c-a62d9a8a1724 from the live domain config.
Nov 14 11:20:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKaZUXCO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:20:33 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2604202-44dd-4cfe-9624-4b3dd63e9d4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a97562c0-4ed4-4f8e-8fec-2bb679065c4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:20:33 user nova-compute[75255]: No targets found.
Nov 14 11:20:33 user nova-compute[75255]: iSNS:
Nov 14 11:20:33 user nova-compute[75255]: No targets found.
Nov 14 11:20:33 user nova-compute[75255]: STATIC:
Nov 14 11:20:33 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3
Nov 14 11:20:33 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:33 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:33 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:a97562c0-4ed4-4f8e-8fec-2bb679065c4e
Nov 14 11:20:33 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:33 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:33 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b
Nov 14 11:20:33 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:33 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:33 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3
Nov 14 11:20:33 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:33 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:33 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:20:33 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:33 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:33 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d
Nov 14 11:20:33 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:33 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:33 user nova-compute[75255]: FIRMWARE:
Nov 14 11:20:33 user nova-compute[75255]: No targets found.
Nov 14 11:20:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:20:33 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:20:33 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee3007a-7620-410f-b592-eb12bbd24a52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a97562c0-4ed4-4f8e-8fec-2bb679065c4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b512c01-c6e8-4b27-8257-811c94844e28]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a97562c0-4ed4-4f8e-8fec-2bb679065c4e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a97562c0-4ed4-4f8e-8fec-2bb679065c4e (non-flash)
Nov 14 11:20:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:20:33 user nova-compute[75255]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a97562c0-4ed4-4f8e-8fec-2bb679065c4e (non-flash)
Nov 14 11:20:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff328556320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c5d3a0-47b0-48bb-bcec-e0d6bc6e056b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6970a6-5da1-4ed1-af2b-b9ce786fff1e]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b2a6d8-943e-428d-837b-5b508fda9acd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad104855-9811-4735-882e-f722d28a6c16]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c9809-0639-4ca9-b0a3-3baa00a28c22]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e534893-8bda-413e-be15-8c1fadb17704]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260]
Nov 14 11:20:33 user nova-compute[75255]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3, portal: 172.16.0.220,3260] successful.
Nov 14 11:20:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4384c5-3b85-49b5-a5fc-ebd9e085fcb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72ea58f-d7d6-48e4-9a75-2cd91e7652e7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== disconnect_volume: return (336ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:20:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'flavor' on Instance uuid 9057f65e-8951-49ad-963c-a62d9a8a1724 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3ac65614-612d-4382-b9e3-0e2176987b99 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.844s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:20:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing instance network info cache due to event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] Acquiring lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] Acquired lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG nova.network.neutron [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:38 user nova-compute[75255]: INFO nova.compute.manager [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Detaching volume 9770a256-2a45-4add-af00-515ef19818a3
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG nova.network.neutron [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updated VIF entry in instance network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG nova.network.neutron [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9a947cec-cda0-458a-b7f1-e7835b1ac8dc req-3e726831-4c94-4f60-adcd-8d51f1d6cdfe service nova] Releasing lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:20:38 user nova-compute[75255]: INFO nova.virt.block_device [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Attempting to driver detach volume 9770a256-2a45-4add-af00-515ef19818a3 from mountpoint /dev/vdb
Nov 14 11:20:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:20:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:20:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7825MB free_disk=25.003280639648438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:20:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Attempting to detach device vdb from instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:20:39 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:20:39 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:20:39 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:20:39 user nova-compute[75255]:   <serial>9770a256-2a45-4add-af00-515ef19818a3</serial>
Nov 14 11:20:39 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:20:39 user nova-compute[75255]: </disk>
Nov 14 11:20:39 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:20:39 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully detached device vdb from instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d from the persistent domain config.
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:20:39 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:20:39 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:20:39 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:20:39 user nova-compute[75255]:   <serial>9770a256-2a45-4add-af00-515ef19818a3</serial>
Nov 14 11:20:39 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:20:39 user nova-compute[75255]: </disk>
Nov 14 11:20:39 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9057f65e-8951-49ad-963c-a62d9a8a1724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 68bca729-db5f-4edd-9549-979c5b00e49b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:20:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG nova.compute.manager [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG nova.compute.manager [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing instance network info cache due to event network-changed-fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] Acquiring lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] Acquired lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG nova.network.neutron [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Refreshing network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG nova.network.neutron [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updated VIF entry in instance network info cache for port fc0b9ee4-f968-428a-be9c-48b6a5b83339. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG nova.network.neutron [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [{"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e4eeb751-78c8-4701-aa25-64a8a9af9fcb req-977ddcad-a92b-4867-88a4-17f3667750e6 service nova] Releasing lock "refresh_cache-7bae2ca8-f0e2-4b1c-8153-0836383dab5d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:40 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:20:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updating instance_info_cache with network_info: [{"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:20:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:20:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:20:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:20:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:20:59 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d is timed out.
Nov 14 11:20:59 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully detached device vdb from instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d from the live domain config.
Nov 14 11:20:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhRqgtBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:20:59 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ae64b-7ee7-4361-8833-ee7941526a04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:20:59 user nova-compute[75255]: No targets found.
Nov 14 11:20:59 user nova-compute[75255]: iSNS:
Nov 14 11:20:59 user nova-compute[75255]: No targets found.
Nov 14 11:20:59 user nova-compute[75255]: STATIC:
Nov 14 11:20:59 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b
Nov 14 11:20:59 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:59 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:59 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3
Nov 14 11:20:59 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:59 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:59 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:20:59 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:59 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:59 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d
Nov 14 11:20:59 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:20:59 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:20:59 user nova-compute[75255]: FIRMWARE:
Nov 14 11:20:59 user nova-compute[75255]: No targets found.
Nov 14 11:20:59 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:20:59 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:20:59 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baeab1e-801f-4bb8-9e5b-9972645740a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d778c0-bc14-4865-86e5-3eb92cf57bcf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:20:59 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:20:59 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:20:59 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:20:59 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:20:59 user nova-compute[75255]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 (non-flash)
Nov 14 11:20:59 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:20:59 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:20:59 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30876fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1b086-1a62-495a-9eca-d7a9d55a17fc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7c7e70-80e6-4597-a1d9-6ab8b188c8b8]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47addc7-77e0-4f1c-9419-74cb23826a36]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a043a06-698b-4035-bc85-db1d7d46f966]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[323387e6-3720-4832-80ad-e5f8e6442626]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1b8a73-be22-486d-8471-9c0b7dcd0f7e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260]
Nov 14 11:20:59 user nova-compute[75255]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3, portal: 172.16.0.220,3260] successful.
Nov 14 11:20:59 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9770a256-2a45-4add-af00-515ef19818a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e029bf19-c47b-4044-a0f2-c5da68ed8841]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] <== disconnect_volume: return (336ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:20:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:21:00 user nova-compute[75255]: DEBUG nova.objects.instance [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'flavor' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:21:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2b2ae1f9-b1a4-4da6-82ce-5fe679e2154a tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.127s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:03 user nova-compute[75255]: INFO nova.compute.manager [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Terminating instance
Nov 14 11:21:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce003959-6a08-4e66-8619-5e2fb8216d3b req-9b71f21f-e84d-487d-9d4a-00c1c19cd73c service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-unplugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce003959-6a08-4e66-8619-5e2fb8216d3b req-9b71f21f-e84d-487d-9d4a-00c1c19cd73c service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce003959-6a08-4e66-8619-5e2fb8216d3b req-9b71f21f-e84d-487d-9d4a-00c1c19cd73c service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce003959-6a08-4e66-8619-5e2fb8216d3b req-9b71f21f-e84d-487d-9d4a-00c1c19cd73c service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce003959-6a08-4e66-8619-5e2fb8216d3b req-9b71f21f-e84d-487d-9d4a-00c1c19cd73c service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-unplugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce003959-6a08-4e66-8619-5e2fb8216d3b req-9b71f21f-e84d-487d-9d4a-00c1c19cd73c service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-unplugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Instance destroyed successfully.
Nov 14 11:21:04 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'resources' on Instance uuid 9057f65e-8951-49ad-963c-a62d9a8a1724 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1601762684',display_name='tempest-ServerActionsTestOtherA-server-15543675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1601762684',id=25,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhcx8OgnnF0sgX7lf5Bb/Ju9ZNs5VH3jSw48Yyf9PzYERs0enurSVnV4ZbPhgypn+lr+5fCW5y+08OCGzhvWHfPpd7bjdumzk5JuaEuMh4lWf12uun4pcHA18MdN3akUA==',key_name='tempest-keypair-1173659248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-33uqdt3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=9057f65e-8951-49ad-963c-a62d9a8a1724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "address": "fa:16:3e:78:56:18", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aac53ad-ce", "ovs_interfaceid": "1aac53ad-ce4c-44b3-a42c-d947e908163a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG os_vif [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aac53ad-ce, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25392a2b-ae37-444a-a474-6460f5fd51c4) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:21:04 user nova-compute[75255]: INFO os_vif [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:56:18,bridge_name='br-int',has_traffic_filtering=True,id=1aac53ad-ce4c-44b3-a42c-d947e908163a,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aac53ad-ce')
Nov 14 11:21:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Deleting instance files /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724_del
Nov 14 11:21:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Deletion of /opt/stack/data/nova/instances/9057f65e-8951-49ad-963c-a62d9a8a1724_del complete
Nov 14 11:21:04 user nova-compute[75255]: INFO nova.compute.manager [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 11:21:04 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:21:04 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:05 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Took 0.76 seconds to deallocate network for instance.
Nov 14 11:21:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-18c9e4eb-a304-4492-a625-4891a45fc72b req-e6a6378e-8173-47f5-887d-2c68a9b304d6 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-deleted-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:05 user nova-compute[75255]: INFO nova.compute.manager [req-18c9e4eb-a304-4492-a625-4891a45fc72b req-e6a6378e-8173-47f5-887d-2c68a9b304d6 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Neutron deleted interface 1aac53ad-ce4c-44b3-a42c-d947e908163a; detaching it from the instance and deleting it from the info cache
Nov 14 11:21:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-18c9e4eb-a304-4492-a625-4891a45fc72b req-e6a6378e-8173-47f5-887d-2c68a9b304d6 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-18c9e4eb-a304-4492-a625-4891a45fc72b req-e6a6378e-8173-47f5-887d-2c68a9b304d6 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Detach interface failed, port_id=1aac53ad-ce4c-44b3-a42c-d947e908163a, reason: Instance 9057f65e-8951-49ad-963c-a62d9a8a1724 could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:05 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Deleted allocations for instance 9057f65e-8951-49ad-963c-a62d9a8a1724
Nov 14 11:21:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f0cb37c-202d-440f-89ff-4b0a0ccfcf34 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.221s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-0a8ae355-e8fb-4f1d-8ef5-0d985a27b897 req-a025c5df-e84b-4043-add7-66dc7d310da0 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0a8ae355-e8fb-4f1d-8ef5-0d985a27b897 req-a025c5df-e84b-4043-add7-66dc7d310da0 service nova] Acquiring lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0a8ae355-e8fb-4f1d-8ef5-0d985a27b897 req-a025c5df-e84b-4043-add7-66dc7d310da0 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0a8ae355-e8fb-4f1d-8ef5-0d985a27b897 req-a025c5df-e84b-4043-add7-66dc7d310da0 service nova] Lock "9057f65e-8951-49ad-963c-a62d9a8a1724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-0a8ae355-e8fb-4f1d-8ef5-0d985a27b897 req-a025c5df-e84b-4043-add7-66dc7d310da0 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] No waiting events found dispatching network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:05 user nova-compute[75255]: WARNING nova.compute.manager [req-0a8ae355-e8fb-4f1d-8ef5-0d985a27b897 req-a025c5df-e84b-4043-add7-66dc7d310da0 service nova] [instance: 9057f65e-8951-49ad-963c-a62d9a8a1724] Received unexpected event network-vif-plugged-1aac53ad-ce4c-44b3-a42c-d947e908163a for instance with vm_state deleted and task_state None.
Nov 14 11:21:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing instance network info cache due to event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:21:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updated VIF entry in instance network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4fe4e20e-6370-4588-a4e9-2aa6b1fbbc56 req-f0a6f239-a038-4701-aa20-29439e90eca4 service nova] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:13 user nova-compute[75255]: INFO nova.compute.manager [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Shelve offloading
Nov 14 11:21:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-0a504ee0-a857-44fe-aa1c-6d0873c01ece req-7fe23d7a-c852-44e4-ae75-f4259b649802 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-unplugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0a504ee0-a857-44fe-aa1c-6d0873c01ece req-7fe23d7a-c852-44e4-ae75-f4259b649802 service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0a504ee0-a857-44fe-aa1c-6d0873c01ece req-7fe23d7a-c852-44e4-ae75-f4259b649802 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0a504ee0-a857-44fe-aa1c-6d0873c01ece req-7fe23d7a-c852-44e4-ae75-f4259b649802 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-0a504ee0-a857-44fe-aa1c-6d0873c01ece req-7fe23d7a-c852-44e4-ae75-f4259b649802 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-unplugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:13 user nova-compute[75255]: WARNING nova.compute.manager [req-0a504ee0-a857-44fe-aa1c-6d0873c01ece req-7fe23d7a-c852-44e4-ae75-f4259b649802 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received unexpected event network-vif-unplugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with vm_state active and task_state shelving.
Nov 14 11:21:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance destroyed successfully.
Nov 14 11:21:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:21:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:14 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:21:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:14 user nova-compute[75255]: DEBUG nova.network.neutron [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:21:15 user nova-compute[75255]: INFO nova.compute.claims [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Claim successful on node user
Nov 14 11:21:15 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance destroyed successfully.
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'resources' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-805539077',display_name='tempest-TestShelveInstance-server-805539077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-805539077',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTHn8Uben8kK2HaTK5LXH7Z3lHOnonZd+cDcfzzZ1UJxtCZoI3X6OBueXUBHhGY1k7PvPP/6+WSVMWzc5YYhg+EbZ0iUNr7HCK+glYRgYaTtTB0GabI5QPZwmVJZX9EDw==',key_name='tempest-TestShelveInstance-287110248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b5b339310242ea8837a4a3ffee6532',ramdisk_id='',reservation_id='r-g6gjeea3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1188210100',owner_user_name='tempest-TestShelveInstance-1188210100-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:19:32Z,user_data=None,user_id='0a68d5e2b8b64a289abf08bba42e1033',uuid=68bca729-db5f-4edd-9549-979c5b00e49b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converting VIF {"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_vif [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a833ede-1e, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99092bef-4a66-4712-8eb4-c6dd44e23be1) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:21:15 user nova-compute[75255]: INFO os_vif [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e')
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:21:15 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a75720-05d8-43f6-9860-537cf1cc3ce6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:21:15 user nova-compute[75255]: No targets found.
Nov 14 11:21:15 user nova-compute[75255]: iSNS:
Nov 14 11:21:15 user nova-compute[75255]: No targets found.
Nov 14 11:21:15 user nova-compute[75255]: STATIC:
Nov 14 11:21:15 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b
Nov 14 11:21:15 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:21:15 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:21:15 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:21:15 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:21:15 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:21:15 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d
Nov 14 11:21:15 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:21:15 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:21:15 user nova-compute[75255]: FIRMWARE:
Nov 14 11:21:15 user nova-compute[75255]: No targets found.
Nov 14 11:21:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:21:15 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:21:15 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d95e5a5-9d7d-4fb3-b35d-52cfe1f8b361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0143e2-42eb-4dad-b0bb-94fd712a435e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:21:15 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:21:15 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:21:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:21:15 user nova-compute[75255]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:21:15 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:21:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3285803a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b'): ({'sde'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Removing single pathed devices sde {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6584d721-6ac2-4362-9921-dfb253495601]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[531ea739-0df0-416a-8c3a-e23c6b62e961]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Flushing IO for device /dev/sde {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925053a-ffb6-4f25-9640-9167e847bc11]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe923e5a-3df5-460c-9c79-1740b80cfb56]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:15 user nova-compute[75255]: WARNING nova.compute.manager [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received unexpected event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with vm_state active and task_state shelving.
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing instance network info cache due to event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.network.neutron [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[29effd02-5a4f-457b-97e6-e5c838d8e94f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3cf161-0dbb-4042-986b-c3c1b77ecb0a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]
Nov 14 11:21:15 user nova-compute[75255]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.
Nov 14 11:21:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:21:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c51c0-71ca-4ea9-838d-e07867f95940]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] <== disconnect_volume: return (322ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:21:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Deleting instance files /opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b_del
Nov 14 11:21:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Deletion of /opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b_del complete
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:21:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.policy [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d356b8218514e458c45ec3066bad892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddf20982f454dd4a1c831e064b41ec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:21:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Creating image(s)
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "/opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "/opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updated VIF entry in instance network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": null, "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7a833ede-1e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e54f1057-1830-41ba-8032-de416a75cbf1 req-c41b0634-fb92-4728-a503-b452d3584515 service nova] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk 1073741824" returned: 0 in 0.051s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Successfully created port: af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Cannot resize image /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Ensure instance console log exists: /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:17 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Deleted allocations for instance 68bca729-db5f-4edd-9549-979c5b00e49b
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'numa_topology' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.objects.base [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Object Instance<68bca729-db5f-4edd-9549-979c5b00e49b> lazy-loaded attributes: resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b41c2c1d-eb1e-43cf-b776-81129f5f3f1c tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.085s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Successfully updated port: af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquired lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-changed-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Refreshing instance network info cache due to event network-changed-af27f923-fba8-4b30-a59b-c05c323997b8. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] Acquiring lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:17 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.neutron [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Updating instance_info_cache with network_info: [{"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Releasing lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Instance network_info: |[{"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] Acquired lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Refreshing network info cache for port af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Start _get_guest_xml network_info=[{"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:21:18 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:21:18 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1924753918',display_name='tempest-VolumesSnapshotTestJSON-instance-1924753918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1924753918',id=31,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCXtsOwwIYl4EyBsg7s/hxN14bNS+0rBoCRWcRjZGwKgaC01s7QJeM2VcIk3Fa9fOtZEdFEITKQ2YLjNeRFEIOMejo93G/QFICnVMjRaJgdXXU1aCOUFjEOKkgfUSD11Q==',key_name='tempest-keypair-1164911972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ddf20982f454dd4a1c831e064b41ec6',ramdisk_id='',reservation_id='r-i8cdeha1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-610019682',owner_user_name='tempest-VolumesSnapshotTestJSON-610019682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d356b8218514e458c45ec3066bad892',uuid=bd25e139-e7bc-4e57-a8d9-e248b444fae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converting VIF {"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:99:05,bridge_name='br-int',has_traffic_filtering=True,id=af27f923-fba8-4b30-a59b-c05c323997b8,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf27f923-fb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'pci_devices' on Instance uuid bd25e139-e7bc-4e57-a8d9-e248b444fae3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:21:18 user nova-compute[75255]:   <uuid>bd25e139-e7bc-4e57-a8d9-e248b444fae3</uuid>
Nov 14 11:21:18 user nova-compute[75255]:   <name>instance-0000001f</name>
Nov 14 11:21:18 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:21:18 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:21:18 user nova-compute[75255]:   <metadata>
Nov 14 11:21:18 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:21:18 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:21:18 user nova-compute[75255]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1924753918</nova:name>
Nov 14 11:21:18 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:21:18</nova:creationTime>
Nov 14 11:21:18 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:21:18 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:21:18 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:21:18 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:21:18 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:21:18 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:21:18 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:21:18 user nova-compute[75255]:       <nova:owner>
Nov 14 11:21:18 user nova-compute[75255]:         <nova:user uuid="5d356b8218514e458c45ec3066bad892">tempest-VolumesSnapshotTestJSON-610019682-project-member</nova:user>
Nov 14 11:21:18 user nova-compute[75255]:         <nova:project uuid="3ddf20982f454dd4a1c831e064b41ec6">tempest-VolumesSnapshotTestJSON-610019682</nova:project>
Nov 14 11:21:18 user nova-compute[75255]:       </nova:owner>
Nov 14 11:21:18 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:21:18 user nova-compute[75255]:       <nova:ports>
Nov 14 11:21:18 user nova-compute[75255]:         <nova:port uuid="af27f923-fba8-4b30-a59b-c05c323997b8">
Nov 14 11:21:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 11:21:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:21:18 user nova-compute[75255]:       </nova:ports>
Nov 14 11:21:18 user nova-compute[75255]:     </nova:instance>
Nov 14 11:21:18 user nova-compute[75255]:   </metadata>
Nov 14 11:21:18 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:21:18 user nova-compute[75255]:     <system>
Nov 14 11:21:18 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:21:18 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:21:18 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:21:18 user nova-compute[75255]:       <entry name="serial">bd25e139-e7bc-4e57-a8d9-e248b444fae3</entry>
Nov 14 11:21:18 user nova-compute[75255]:       <entry name="uuid">bd25e139-e7bc-4e57-a8d9-e248b444fae3</entry>
Nov 14 11:21:18 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:21:18 user nova-compute[75255]:     </system>
Nov 14 11:21:18 user nova-compute[75255]:   </sysinfo>
Nov 14 11:21:18 user nova-compute[75255]:   <os>
Nov 14 11:21:18 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:21:18 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:21:18 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:21:18 user nova-compute[75255]:   </os>
Nov 14 11:21:18 user nova-compute[75255]:   <features>
Nov 14 11:21:18 user nova-compute[75255]:     <acpi/>
Nov 14 11:21:18 user nova-compute[75255]:     <apic/>
Nov 14 11:21:18 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:21:18 user nova-compute[75255]:   </features>
Nov 14 11:21:18 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:21:18 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:21:18 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:21:18 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:21:18 user nova-compute[75255]:   </clock>
Nov 14 11:21:18 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:21:18 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:21:18 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:21:18 user nova-compute[75255]:   </cpu>
Nov 14 11:21:18 user nova-compute[75255]:   <devices>
Nov 14 11:21:18 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:21:18 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:21:18 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk"/>
Nov 14 11:21:18 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:21:18 user nova-compute[75255]:     </disk>
Nov 14 11:21:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:21:18 user nova-compute[75255]:       <mac address="fa:16:3e:06:99:05"/>
Nov 14 11:21:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:21:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:21:18 user nova-compute[75255]:       <target dev="tapaf27f923-fb"/>
Nov 14 11:21:18 user nova-compute[75255]:     </interface>
Nov 14 11:21:18 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:21:18 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/console.log" append="off"/>
Nov 14 11:21:18 user nova-compute[75255]:     </serial>
Nov 14 11:21:18 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:21:18 user nova-compute[75255]:     <video>
Nov 14 11:21:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:21:18 user nova-compute[75255]:     </video>
Nov 14 11:21:18 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:21:18 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:21:18 user nova-compute[75255]:     </rng>
Nov 14 11:21:18 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:21:18 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:21:18 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:21:18 user nova-compute[75255]:     </memballoon>
Nov 14 11:21:18 user nova-compute[75255]:   </devices>
Nov 14 11:21:18 user nova-compute[75255]: </domain>
Nov 14 11:21:18 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1924753918',display_name='tempest-VolumesSnapshotTestJSON-instance-1924753918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1924753918',id=31,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCXtsOwwIYl4EyBsg7s/hxN14bNS+0rBoCRWcRjZGwKgaC01s7QJeM2VcIk3Fa9fOtZEdFEITKQ2YLjNeRFEIOMejo93G/QFICnVMjRaJgdXXU1aCOUFjEOKkgfUSD11Q==',key_name='tempest-keypair-1164911972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ddf20982f454dd4a1c831e064b41ec6',ramdisk_id='',reservation_id='r-i8cdeha1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-610019682',owner_user_name='tempest-VolumesSnapshotTestJSON-610019682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d356b8218514e458c45ec3066bad892',uuid=bd25e139-e7bc-4e57-a8d9-e248b444fae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converting VIF {"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:99:05,bridge_name='br-int',has_traffic_filtering=True,id=af27f923-fba8-4b30-a59b-c05c323997b8,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf27f923-fb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG os_vif [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:99:05,bridge_name='br-int',has_traffic_filtering=True,id=af27f923-fba8-4b30-a59b-c05c323997b8,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf27f923-fb') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '346cdae0-9c1c-5f8e-ad0e-ac7ea56b30e0', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf27f923-fb, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf27f923-fb, col_values=(('qos', UUID('167b1d16-af49-40e7-8d91-b8971e99c253')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf27f923-fb, col_values=(('external_ids', {'iface-id': 'af27f923-fba8-4b30-a59b-c05c323997b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:99:05', 'vm-uuid': 'bd25e139-e7bc-4e57-a8d9-e248b444fae3'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:18 user nova-compute[75255]: INFO os_vif [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:99:05,bridge_name='br-int',has_traffic_filtering=True,id=af27f923-fba8-4b30-a59b-c05c323997b8,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf27f923-fb')
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No VIF found with MAC fa:16:3e:06:99:05, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Updated VIF entry in instance network info cache for port af27f923-fba8-4b30-a59b-c05c323997b8. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Updating instance_info_cache with network_info: [{"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6cadd007-94a8-4d09-a070-8cd76c6b1740 req-881d89b3-689a-45f2-82de-cb20b8670d07 service nova] Releasing lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-2724c028-17c7-44ef-99a0-3fee9148ce2a req-584d19fc-d966-48d9-9b6f-170417bbef72 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2724c028-17c7-44ef-99a0-3fee9148ce2a req-584d19fc-d966-48d9-9b6f-170417bbef72 service nova] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2724c028-17c7-44ef-99a0-3fee9148ce2a req-584d19fc-d966-48d9-9b6f-170417bbef72 service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2724c028-17c7-44ef-99a0-3fee9148ce2a req-584d19fc-d966-48d9-9b6f-170417bbef72 service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-2724c028-17c7-44ef-99a0-3fee9148ce2a req-584d19fc-d966-48d9-9b6f-170417bbef72 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] No waiting events found dispatching network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:19 user nova-compute[75255]: WARNING nova.compute.manager [req-2724c028-17c7-44ef-99a0-3fee9148ce2a req-584d19fc-d966-48d9-9b6f-170417bbef72 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received unexpected event network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 for instance with vm_state building and task_state spawning.
Nov 14 11:21:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:21:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Instance spawned successfully.
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-03e50408-48f2-4971-bd3d-e8a328b66bdf req-bf6fa9fd-3e43-4a60-9a10-c62bab5c5e7b service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-03e50408-48f2-4971-bd3d-e8a328b66bdf req-bf6fa9fd-3e43-4a60-9a10-c62bab5c5e7b service nova] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-03e50408-48f2-4971-bd3d-e8a328b66bdf req-bf6fa9fd-3e43-4a60-9a10-c62bab5c5e7b service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-03e50408-48f2-4971-bd3d-e8a328b66bdf req-bf6fa9fd-3e43-4a60-9a10-c62bab5c5e7b service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-03e50408-48f2-4971-bd3d-e8a328b66bdf req-bf6fa9fd-3e43-4a60-9a10-c62bab5c5e7b service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] No waiting events found dispatching network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:21 user nova-compute[75255]: WARNING nova.compute.manager [req-03e50408-48f2-4971-bd3d-e8a328b66bdf req-bf6fa9fd-3e43-4a60-9a10-c62bab5c5e7b service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received unexpected event network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 for instance with vm_state building and task_state spawning.
Nov 14 11:21:21 user nova-compute[75255]: INFO nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 14 11:21:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:21:21 user nova-compute[75255]: INFO nova.compute.manager [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Took 6.39 seconds to build instance.
Nov 14 11:21:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f525d25a-21d0-4a9f-8656-e0db35d69cd3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.487s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:28 user nova-compute[75255]: INFO nova.compute.manager [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Terminating instance
Nov 14 11:21:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-a2a356ce-ac4f-45ea-b0c3-d33ad8faf95b req-c51d9682-bc38-4c5c-818f-28a50cc2e435 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a2a356ce-ac4f-45ea-b0c3-d33ad8faf95b req-c51d9682-bc38-4c5c-818f-28a50cc2e435 service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a2a356ce-ac4f-45ea-b0c3-d33ad8faf95b req-c51d9682-bc38-4c5c-818f-28a50cc2e435 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a2a356ce-ac4f-45ea-b0c3-d33ad8faf95b req-c51d9682-bc38-4c5c-818f-28a50cc2e435 service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-a2a356ce-ac4f-45ea-b0c3-d33ad8faf95b req-c51d9682-bc38-4c5c-818f-28a50cc2e435 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-a2a356ce-ac4f-45ea-b0c3-d33ad8faf95b req-c51d9682-bc38-4c5c-818f-28a50cc2e435 service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-unplugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Instance destroyed successfully.
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'resources' on Instance uuid 7bae2ca8-f0e2-4b1c-8153-0836383dab5d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-601843745',display_name='tempest-ServerRescueNegativeTestJSON-server-601843745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-601843745',id=23,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXbThBksLRb7OJ/ZqAWmSa7CpRhp6HVt9MtrWqjBQuNdICzPnlAUwWGwrQkljFKbWOMwvEByCdSwGK9oOQbw28XpMokcEie6HNS3TlH5BwHKRbIQm6fefmSlTyorBkkOQ==',key_name='tempest-keypair-527098458',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-3um6ny4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=7bae2ca8-f0e2-4b1c-8153-0836383dab5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "address": "fa:16:3e:6b:25:a0", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0b9ee4-f9", "ovs_interfaceid": "fc0b9ee4-f968-428a-be9c-48b6a5b83339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG os_vif [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc0b9ee4-f9, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61db256e-f727-4014-ac93-ba193f94b7cf) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:29 user nova-compute[75255]: INFO os_vif [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:25:a0,bridge_name='br-int',has_traffic_filtering=True,id=fc0b9ee4-f968-428a-be9c-48b6a5b83339,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0b9ee4-f9')
Nov 14 11:21:29 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Deleting instance files /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d_del
Nov 14 11:21:29 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Deletion of /opt/stack/data/nova/instances/7bae2ca8-f0e2-4b1c-8153-0836383dab5d_del complete
Nov 14 11:21:29 user nova-compute[75255]: INFO nova.compute.manager [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 11:21:29 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:21:29 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:21:30 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:30 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Took 0.77 seconds to deallocate network for instance.
Nov 14 11:21:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:30 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:21:30 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:21:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:30 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Deleted allocations for instance 7bae2ca8-f0e2-4b1c-8153-0836383dab5d
Nov 14 11:21:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5bd-5f7a-4ccb-afca-ed6d94ada633 tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-447b7889-f814-4ae0-b192-797bd36fdb1a req-09cf256d-71f8-40a7-93aa-6c0e9d632cae service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-447b7889-f814-4ae0-b192-797bd36fdb1a req-09cf256d-71f8-40a7-93aa-6c0e9d632cae service nova] Acquiring lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-447b7889-f814-4ae0-b192-797bd36fdb1a req-09cf256d-71f8-40a7-93aa-6c0e9d632cae service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-447b7889-f814-4ae0-b192-797bd36fdb1a req-09cf256d-71f8-40a7-93aa-6c0e9d632cae service nova] Lock "7bae2ca8-f0e2-4b1c-8153-0836383dab5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-447b7889-f814-4ae0-b192-797bd36fdb1a req-09cf256d-71f8-40a7-93aa-6c0e9d632cae service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] No waiting events found dispatching network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:31 user nova-compute[75255]: WARNING nova.compute.manager [req-447b7889-f814-4ae0-b192-797bd36fdb1a req-09cf256d-71f8-40a7-93aa-6c0e9d632cae service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received unexpected event network-vif-plugged-fc0b9ee4-f968-428a-be9c-48b6a5b83339 for instance with vm_state deleted and task_state None.
Nov 14 11:21:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-447b7889-f814-4ae0-b192-797bd36fdb1a req-09cf256d-71f8-40a7-93aa-6c0e9d632cae service nova] [instance: 7bae2ca8-f0e2-4b1c-8153-0836383dab5d] Received event network-vif-deleted-fc0b9ee4-f968-428a-be9c-48b6a5b83339 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:21:37 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:39 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:21:39 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8115MB free_disk=25.019264221191406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 66031f17-4225-4c50-bd18-3df496586023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:21:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:21:40 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:21:40 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:21:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:21:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:41 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:41 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:41 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:21:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:21:48 user nova-compute[75255]: INFO nova.compute.manager [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Unrescuing
Nov 14 11:21:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquired lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Releasing lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'flavor' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c6b1420-526f-4763-8f54-afb42e60ea23 req-0e23490e-fc3e-445a-8f02-212781007ff4 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c6b1420-526f-4763-8f54-afb42e60ea23 req-0e23490e-fc3e-445a-8f02-212781007ff4 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c6b1420-526f-4763-8f54-afb42e60ea23 req-0e23490e-fc3e-445a-8f02-212781007ff4 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c6b1420-526f-4763-8f54-afb42e60ea23 req-0e23490e-fc3e-445a-8f02-212781007ff4 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c6b1420-526f-4763-8f54-afb42e60ea23 req-0e23490e-fc3e-445a-8f02-212781007ff4 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:49 user nova-compute[75255]: WARNING nova.compute.manager [req-8c6b1420-526f-4763-8f54-afb42e60ea23 req-0e23490e-fc3e-445a-8f02-212781007ff4 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:21:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing instance network info cache due to event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] Acquiring lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] Acquired lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG nova.network.neutron [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:21:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:49 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance destroyed successfully.
Nov 14 11:21:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updated VIF entry in instance network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:21:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cf384ac3-1a64-458d-b4d7-da62ef8f0c66 req-c9259136-369e-4f5f-8a3d-826d46a8f0f1 service nova] Releasing lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:51 user nova-compute[75255]: WARNING nova.compute.manager [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:21:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:51 user nova-compute[75255]: WARNING nova.compute.manager [req-7bcc8014-cc09-48d8-9cc4-1f9fdc42a74e req-fa03b158-466e-4885-9e28-95ba1d66317c service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing instance network info cache due to event network-changed-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] Acquiring lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] Acquired lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:21:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Refreshing network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:21:52 user nova-compute[75255]: DEBUG nova.network.neutron [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updated VIF entry in instance network info cache for port 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:21:52 user nova-compute[75255]: DEBUG nova.network.neutron [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [{"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:21:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3e31771c-069c-45e2-a798-65f939b50c33 req-fd9ffdf7-a910-4ac2-8132-290f25df0c1a service nova] Releasing lock "refresh_cache-ddc1e1f7-468c-411d-8406-4f22bf7b457b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:21:53 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d5f54d2c-624e-432f-9d53-b6dd18174bb0 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:21:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-a7500385-58b1-45e7-bc7c-f42f6f24d0da req-7317d44e-8533-4e21-9b6a-6205dd87fb96 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:21:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a7500385-58b1-45e7-bc7c-f42f6f24d0da req-7317d44e-8533-4e21-9b6a-6205dd87fb96 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:21:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a7500385-58b1-45e7-bc7c-f42f6f24d0da req-7317d44e-8533-4e21-9b6a-6205dd87fb96 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:21:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a7500385-58b1-45e7-bc7c-f42f6f24d0da req-7317d44e-8533-4e21-9b6a-6205dd87fb96 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:21:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-a7500385-58b1-45e7-bc7c-f42f6f24d0da req-7317d44e-8533-4e21-9b6a-6205dd87fb96 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:21:53 user nova-compute[75255]: WARNING nova.compute.manager [req-a7500385-58b1-45e7-bc7c-f42f6f24d0da req-7317d44e-8533-4e21-9b6a-6205dd87fb96 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state active and task_state None.
Nov 14 11:21:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:21:55 user nova-compute[75255]: INFO nova.compute.manager [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] instance snapshotting
Nov 14 11:21:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Beginning live snapshot process
Nov 14 11:21:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa9lskc9x/988b377d26594e4193ca91aa00f805f1.delta 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa9lskc9x/988b377d26594e4193ca91aa00f805f1.delta 1073741824" returned: 0 in 0.052s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:56 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 11:21:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:21:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] COPY block job progress, current cursor: 47775744 final cursor: 75497472 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:21:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:21:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 11:21:58 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:21:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa9lskc9x/988b377d26594e4193ca91aa00f805f1.delta /opt/stack/data/nova/instances/snapshots/tmpa9lskc9x/988b377d26594e4193ca91aa00f805f1 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:21:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa9lskc9x/988b377d26594e4193ca91aa00f805f1.delta /opt/stack/data/nova/instances/snapshots/tmpa9lskc9x/988b377d26594e4193ca91aa00f805f1" returned: 0 in 0.716s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:21:59 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Snapshot extracted, beginning image upload
Nov 14 11:21:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:21:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Snapshot image upload complete
Nov 14 11:22:01 user nova-compute[75255]: INFO nova.compute.manager [None req-fbbff72f-0cd9-4a77-aed0-d983ac64bbf6 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Took 5.76 seconds to snapshot the instance on the hypervisor.
Nov 14 11:22:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:22:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:21 user nova-compute[75255]: INFO nova.compute.manager [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Detaching volume 95a2ab19-def6-4aa7-b2a5-d213b16e1a7d
Nov 14 11:22:21 user nova-compute[75255]: INFO nova.virt.block_device [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Attempting to driver detach volume 95a2ab19-def6-4aa7-b2a5-d213b16e1a7d from mountpoint /dev/vdb
Nov 14 11:22:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Attempting to detach device vdb from instance ddc1e1f7-468c-411d-8406-4f22bf7b457b from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:22:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:22:21 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:22:21 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:22:21 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:22:21 user nova-compute[75255]:   <serial>95a2ab19-def6-4aa7-b2a5-d213b16e1a7d</serial>
Nov 14 11:22:21 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:22:21 user nova-compute[75255]: </disk>
Nov 14 11:22:21 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:22:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Successfully detached device vdb from instance ddc1e1f7-468c-411d-8406-4f22bf7b457b from the persistent domain config.
Nov 14 11:22:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddc1e1f7-468c-411d-8406-4f22bf7b457b from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:22:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:22:21 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:22:21 user nova-compute[75255]:   <source dev="/dev/sdf"/>
Nov 14 11:22:21 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:22:21 user nova-compute[75255]:   <serial>95a2ab19-def6-4aa7-b2a5-d213b16e1a7d</serial>
Nov 14 11:22:21 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:22:21 user nova-compute[75255]: </disk>
Nov 14 11:22:21 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:22:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "66031f17-4225-4c50-bd18-3df496586023" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:24 user nova-compute[75255]: INFO nova.compute.manager [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Terminating instance
Nov 14 11:22:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-8cc1d5ca-08a1-46e6-9d78-6f8e224403bc req-94fec6c9-6239-42d6-a0cf-98806b1bcb8c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-unplugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8cc1d5ca-08a1-46e6-9d78-6f8e224403bc req-94fec6c9-6239-42d6-a0cf-98806b1bcb8c service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8cc1d5ca-08a1-46e6-9d78-6f8e224403bc req-94fec6c9-6239-42d6-a0cf-98806b1bcb8c service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8cc1d5ca-08a1-46e6-9d78-6f8e224403bc req-94fec6c9-6239-42d6-a0cf-98806b1bcb8c service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-8cc1d5ca-08a1-46e6-9d78-6f8e224403bc req-94fec6c9-6239-42d6-a0cf-98806b1bcb8c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-unplugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:22:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-8cc1d5ca-08a1-46e6-9d78-6f8e224403bc req-94fec6c9-6239-42d6-a0cf-98806b1bcb8c service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-unplugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] Instance destroyed successfully.
Nov 14 11:22:25 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'resources' on Instance uuid 66031f17-4225-4c50-bd18-3df496586023 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1506170198',display_name='tempest-ServerRescueNegativeTestJSON-server-1506170198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1506170198',id=2,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:08:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-wdlro802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:08:21Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=66031f17-4225-4c50-bd18-3df496586023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "10813fe9-0bbf-4535-87ea-34769197f996", "address": "fa:16:3e:da:f5:ff", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10813fe9-0b", "ovs_interfaceid": "10813fe9-0bbf-4535-87ea-34769197f996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG os_vif [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10813fe9-0b, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a014ac24-5795-4cf4-88db-7bb598393042) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:25 user nova-compute[75255]: INFO os_vif [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:f5:ff,bridge_name='br-int',has_traffic_filtering=True,id=10813fe9-0bbf-4535-87ea-34769197f996,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10813fe9-0b')
Nov 14 11:22:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Deleting instance files /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023_del
Nov 14 11:22:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Deletion of /opt/stack/data/nova/instances/66031f17-4225-4c50-bd18-3df496586023_del complete
Nov 14 11:22:25 user nova-compute[75255]: INFO nova.compute.manager [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 66031f17-4225-4c50-bd18-3df496586023] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 11:22:25 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:22:25 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:22:26 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:22:26 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 66031f17-4225-4c50-bd18-3df496586023] Took 0.53 seconds to deallocate network for instance.
Nov 14 11:22:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-eb46a4d4-0512-4db6-99b5-831fc477f864 req-ac34d472-e73c-4b08-8bf3-955dee71ea87 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-deleted-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:22:26 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:22:26 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:22:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:26 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Deleted allocations for instance 66031f17-4225-4c50-bd18-3df496586023
Nov 14 11:22:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f3e6a0f1-692e-4966-94ab-c098a71693ab tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "66031f17-4225-4c50-bd18-3df496586023" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-ed060348-e91b-4b9a-8ba0-9b626fe49ec7 req-b7e8e35c-6fe1-4308-bc0c-1c23e731cec4 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:22:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ed060348-e91b-4b9a-8ba0-9b626fe49ec7 req-b7e8e35c-6fe1-4308-bc0c-1c23e731cec4 service nova] Acquiring lock "66031f17-4225-4c50-bd18-3df496586023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ed060348-e91b-4b9a-8ba0-9b626fe49ec7 req-b7e8e35c-6fe1-4308-bc0c-1c23e731cec4 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ed060348-e91b-4b9a-8ba0-9b626fe49ec7 req-b7e8e35c-6fe1-4308-bc0c-1c23e731cec4 service nova] Lock "66031f17-4225-4c50-bd18-3df496586023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-ed060348-e91b-4b9a-8ba0-9b626fe49ec7 req-b7e8e35c-6fe1-4308-bc0c-1c23e731cec4 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] No waiting events found dispatching network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:22:27 user nova-compute[75255]: WARNING nova.compute.manager [req-ed060348-e91b-4b9a-8ba0-9b626fe49ec7 req-b7e8e35c-6fe1-4308-bc0c-1c23e731cec4 service nova] [instance: 66031f17-4225-4c50-bd18-3df496586023] Received unexpected event network-vif-plugged-10813fe9-0bbf-4535-87ea-34769197f996 for instance with vm_state deleted and task_state None.
Nov 14 11:22:28 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:36 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:40 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:22:40 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:22:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8250MB free_disk=24.996078491210938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:22:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 943d1e23-bb99-4499-83db-eca996c3fedf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:22:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:42 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddc1e1f7-468c-411d-8406-4f22bf7b457b is timed out.
Nov 14 11:22:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Successfully detached device vdb from instance ddc1e1f7-468c-411d-8406-4f22bf7b457b from the live domain config.
Nov 14 11:22:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuPiRkpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:22:42 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb88ca8-3b9c-489a-a7c0-e9508bfe2ba7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:22:42 user nova-compute[75255]: No targets found.
Nov 14 11:22:42 user nova-compute[75255]: iSNS:
Nov 14 11:22:42 user nova-compute[75255]: No targets found.
Nov 14 11:22:42 user nova-compute[75255]: STATIC:
Nov 14 11:22:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:22:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:22:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:22:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d
Nov 14 11:22:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:22:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:22:42 user nova-compute[75255]: FIRMWARE:
Nov 14 11:22:42 user nova-compute[75255]: No targets found.
Nov 14 11:22:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:22:42 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:22:42 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce4f87-5a60-450f-ba55-372fc294c7e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f4940-928c-42cf-bdf1-5e8e5a035b52]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:22:42 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:22:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:22:42 user nova-compute[75255]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d (non-flash)
Nov 14 11:22:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d'): ({'sdf'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Removing single pathed devices sdf {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f2153-ae92-4a7d-af43-e2fa413b1101]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[533bea56-61b6-4a7b-a185-6285345d4855]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Flushing IO for device /dev/sdf {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cc3e74-03b3-4e91-9322-ba3a93884b36]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1605fee-87f8-4504-97f1-eece66aafcdb]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc57540e-a545-45aa-8c9b-3b8329f261f9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c56696-a25f-4fe4-88cb-fbf1c192507b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260]
Nov 14 11:22:42 user nova-compute[75255]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d, portal: 172.16.0.220,3260] successful.
Nov 14 11:22:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a2ab19-def6-4aa7-b2a5-d213b16e1a7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e8b40b-0b23-48ad-b135-e50be45b22f5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] <== disconnect_volume: return (292ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:22:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:22:43 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'flavor' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:22:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0fdaa3da-cf7e-4449-91d0-266e43c21ac1 tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:22:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:22:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:22:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:22:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_power_states {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 24e046fb-04f4-49f8-bfa8-951334e25e5f {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 8d0e0752-e32b-4696-abb1-9ca53cae10fc {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 2bb9fe90-561b-4cf2-a657-756594130121 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid bd25e139-e7bc-4e57-a8d9-e248b444fae3 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "2bb9fe90-561b-4cf2-a657-756594130121" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "2bb9fe90-561b-4cf2-a657-756594130121" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:22:59 user nova-compute[75255]: INFO nova.compute.claims [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Claim successful on node user
Nov 14 11:22:59 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:22:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG nova.network.neutron [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:23:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:23:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG nova.policy [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31467e0715d645ecbfbb209e8eba66ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1dfe665b5444728fff969e0156d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:23:00 user nova-compute[75255]: INFO nova.virt.block_device [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Booting with volume 5963f401-2e5e-471e-a7ff-142a1caaa3cb at /dev/vda
Nov 14 11:23:00 user nova-compute[75255]: DEBUG os_brick.utils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[69441ae6-d942-4329-be00-8536c3029b4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d10fa0-3388-437d-a94d-b4ed5e42c314]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27215f6-c915-4c5b-9f7f-ad6e692d2699]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c555c47c-957f-4e6b-b68b-375b1395bc60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:00 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:23:00 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a6a3a6-14dc-4ee2-abee-35219f1bc07b]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG os_brick.utils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating existing volume attachment record: 7f558074-9501-4ae4-9b5a-070b4e304b26 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:00 user nova-compute[75255]: DEBUG nova.network.neutron [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Successfully created port: b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Successfully updated port: b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquired lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-changed-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Refreshing instance network info cache due to event network-changed-b1108729-e7e5-4de3-99ba-daf01a2ca472. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] Acquiring lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Releasing lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance network_info: |[{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] Acquired lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Refreshing network info cache for port b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updated VIF entry in instance network info cache for port b1108729-e7e5-4de3-99ba-daf01a2ca472. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2d48b16f-a526-48ad-9a0a-7bcef807eb25 req-5b9046fd-2d01-4354-a65e-5c573869154a service nova] Releasing lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "ae76487b-9360-43d4-b081-68186acc2565" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:23:03 user nova-compute[75255]: INFO nova.compute.claims [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Claim successful on node user
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.network.neutron [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:23:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:23:03 user nova-compute[75255]: DEBUG nova.policy [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b82af4602b649889188f0f943c63896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb07eaf3ea24939aeef6eba1bb2293d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:23:03 user nova-compute[75255]: INFO nova.virt.block_device [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Booting with volume-backed-image 26cc9ab5-432f-4182-801c-11cab6c13c7e at /dev/vda
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Successfully created port: 5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:23:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Creating image(s)
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Ensure instance console log exists: /opt/stack/data/nova/instances/eaf8bf74-7ef8-4eca-8098-0a675ca188cb/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Start _get_guest_xml network_info=[{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '7f558074-9501-4ae4-9b5a-070b4e304b26', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eaf8bf74-7ef8-4eca-8098-0a675ca188cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'serial': '5963f401-2e5e-471e-a7ff-142a1caaa3cb'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:23:04 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:04 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:04 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:04 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:04 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb498da5-32ac-4485-8227-b0de2f7503b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:23:04 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f876c2e2-e724-4ca6-916e-70e9c689521d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb] added
Nov 14 11:23:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c17256-aa15-43bc-a79c-4ee2ce268d27]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a31c2-bddf-452a-85b3-b6f8d549d1c6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YioHzsSj {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YioHzsSj" returned: 0 in 0.095s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb59a2e-b33d-4401-8667-828889705763]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YioHzsSj'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Successfully updated port: 5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7881df-b3a1-48d7-ae9e-4c161bbbbc97]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-changed-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Refreshing instance network info cache due to event network-changed-5962caa2-9c61-4cf6-bd36-0b9fc6153aed. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] Acquiring lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c54f7a-f0be-4939-8160-b00c987bd131]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[907433ba-5fe4-4756-abf8-788e772b89b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]
Nov 14 11:23:05 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.
Nov 14 11:23:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[52acaa5a-9144-4e9b-a69f-e1edcacbe773]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:05 user nova-compute[75255]: INFO nova.compute.manager [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Unshelving
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0ef9e-0418-4523-80ab-f2b5f35d9609]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:05 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:05 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d410d207-f1e4-4912-9ef0-16ea659d1395]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:23:05 user nova-compute[75255]: INFO nova.virt.block_device [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Booting with volume 48fbc53d-534d-4d32-8319-6cc35b8cf74b at /dev/vda
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.utils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407eaec-d121-49aa-ab2b-942cffbc001e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c076e2-b115-4d14-bc1c-8b37ce396071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Updating instance_info_cache with network_info: [{"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29803ab-7e98-4041-9d27-707391848244]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1f989-8661-4d5d-9c6d-dbbd040b21b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance network_info: |[{"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] Acquired lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Refreshing network info cache for port 5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:05 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4fbf58-67da-442d-bd80-6abb1f1f6257]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG os_brick.utils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating existing volume attachment record: d488d964-ea21-460d-8023-fafdde6db123 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Updated VIF entry in instance network info cache for port 5962caa2-9c61-4cf6-bd36-0b9fc6153aed. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Updating instance_info_cache with network_info: [{"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9e7c09f-1620-481c-ab40-7e0b75768b59 req-1f7434bb-852d-48d7-8fda-7bc07c6fa30f service nova] Releasing lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23631313765353637', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631313765353637', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112388371',display_name='tempest-ServerActionsTestOtherA-server-2112388371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112388371',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-2efmp59p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=eaf8bf74-7ef8-4eca-8098-0a675ca188cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.objects.instance [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'pci_devices' on Instance uuid eaf8bf74-7ef8-4eca-8098-0a675ca188cb {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:23:06 user nova-compute[75255]:   <uuid>eaf8bf74-7ef8-4eca-8098-0a675ca188cb</uuid>
Nov 14 11:23:06 user nova-compute[75255]:   <name>instance-00000020</name>
Nov 14 11:23:06 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:23:06 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:23:06 user nova-compute[75255]:   <metadata>
Nov 14 11:23:06 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:23:06 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:23:06 user nova-compute[75255]:       <nova:name>tempest-ServerActionsTestOtherA-server-2112388371</nova:name>
Nov 14 11:23:06 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:23:04</nova:creationTime>
Nov 14 11:23:06 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:23:06 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:23:06 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:23:06 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:23:06 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:23:06 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:23:06 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:23:06 user nova-compute[75255]:       <nova:owner>
Nov 14 11:23:06 user nova-compute[75255]:         <nova:user uuid="31467e0715d645ecbfbb209e8eba66ed">tempest-ServerActionsTestOtherA-1585033744-project-member</nova:user>
Nov 14 11:23:06 user nova-compute[75255]:         <nova:project uuid="3d1dfe665b5444728fff969e0156d205">tempest-ServerActionsTestOtherA-1585033744</nova:project>
Nov 14 11:23:06 user nova-compute[75255]:       </nova:owner>
Nov 14 11:23:06 user nova-compute[75255]:       <nova:ports>
Nov 14 11:23:06 user nova-compute[75255]:         <nova:port uuid="b1108729-e7e5-4de3-99ba-daf01a2ca472">
Nov 14 11:23:06 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:23:06 user nova-compute[75255]:         </nova:port>
Nov 14 11:23:06 user nova-compute[75255]:       </nova:ports>
Nov 14 11:23:06 user nova-compute[75255]:     </nova:instance>
Nov 14 11:23:06 user nova-compute[75255]:   </metadata>
Nov 14 11:23:06 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:23:06 user nova-compute[75255]:     <system>
Nov 14 11:23:06 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:23:06 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:23:06 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:23:06 user nova-compute[75255]:       <entry name="serial">eaf8bf74-7ef8-4eca-8098-0a675ca188cb</entry>
Nov 14 11:23:06 user nova-compute[75255]:       <entry name="uuid">eaf8bf74-7ef8-4eca-8098-0a675ca188cb</entry>
Nov 14 11:23:06 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:23:06 user nova-compute[75255]:     </system>
Nov 14 11:23:06 user nova-compute[75255]:   </sysinfo>
Nov 14 11:23:06 user nova-compute[75255]:   <os>
Nov 14 11:23:06 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:23:06 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:23:06 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:23:06 user nova-compute[75255]:   </os>
Nov 14 11:23:06 user nova-compute[75255]:   <features>
Nov 14 11:23:06 user nova-compute[75255]:     <acpi/>
Nov 14 11:23:06 user nova-compute[75255]:     <apic/>
Nov 14 11:23:06 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:23:06 user nova-compute[75255]:   </features>
Nov 14 11:23:06 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:23:06 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:23:06 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:23:06 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:23:06 user nova-compute[75255]:   </clock>
Nov 14 11:23:06 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:23:06 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:23:06 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:23:06 user nova-compute[75255]:   </cpu>
Nov 14 11:23:06 user nova-compute[75255]:   <devices>
Nov 14 11:23:06 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:23:06 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:23:06 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:23:06 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:23:06 user nova-compute[75255]:       <serial>5963f401-2e5e-471e-a7ff-142a1caaa3cb</serial>
Nov 14 11:23:06 user nova-compute[75255]:     </disk>
Nov 14 11:23:06 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:23:06 user nova-compute[75255]:       <mac address="fa:16:3e:2c:a0:12"/>
Nov 14 11:23:06 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:23:06 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:23:06 user nova-compute[75255]:       <target dev="tapb1108729-e7"/>
Nov 14 11:23:06 user nova-compute[75255]:     </interface>
Nov 14 11:23:06 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:23:06 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/eaf8bf74-7ef8-4eca-8098-0a675ca188cb/console.log" append="off"/>
Nov 14 11:23:06 user nova-compute[75255]:     </serial>
Nov 14 11:23:06 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:23:06 user nova-compute[75255]:     <video>
Nov 14 11:23:06 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:23:06 user nova-compute[75255]:     </video>
Nov 14 11:23:06 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:23:06 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:23:06 user nova-compute[75255]:     </rng>
Nov 14 11:23:06 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:23:06 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:23:06 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:23:06 user nova-compute[75255]:     </memballoon>
Nov 14 11:23:06 user nova-compute[75255]:   </devices>
Nov 14 11:23:06 user nova-compute[75255]: </domain>
Nov 14 11:23:06 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112388371',display_name='tempest-ServerActionsTestOtherA-server-2112388371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112388371',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-2efmp59p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=eaf8bf74-7ef8-4eca-8098-0a675ca188cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_vif [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28d454d2-4e01-56d2-ae33-65ba160b91c5', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1108729-e7, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1108729-e7, col_values=(('qos', UUID('df640624-cf2e-4252-a72c-72aa20513818')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1108729-e7, col_values=(('external_ids', {'iface-id': 'b1108729-e7e5-4de3-99ba-daf01a2ca472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:a0:12', 'vm-uuid': 'eaf8bf74-7ef8-4eca-8098-0a675ca188cb'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:06 user nova-compute[75255]: INFO os_vif [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7')
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-changed-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Refreshing instance network info cache due to event network-changed-af27f923-fba8-4b30-a59b-c05c323997b8. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] Acquiring lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] Acquired lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.network.neutron [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Refreshing network info cache for port af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No VIF found with MAC fa:16:3e:2c:a0:12, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'flavor' on Instance uuid bd25e139-e7bc-4e57-a8d9-e248b444fae3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:06 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Ignoring supplied device name: /dev/vdb
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.network.neutron [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Updated VIF entry in instance network info cache for port af27f923-fba8-4b30-a59b-c05c323997b8. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.network.neutron [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Updating instance_info_cache with network_info: [{"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3df0b1ee-6984-49ec-a98c-e67880af2e09 req-9d305ffc-45ae-453f-a200-e2b6fc98ed9f service nova] Releasing lock "refresh_cache-bd25e139-e7bc-4e57-a8d9-e248b444fae3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:06 user nova-compute[75255]: INFO nova.compute.manager [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Attaching volume f79dfa08-66e4-4e97-8cde-948b4d60b3d3 to /dev/vdb
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.utils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[20659a82-99ca-47e3-ab69-4d3b49c99d7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6442de-07c0-473b-8710-3c3ba40242e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2033e45f-9710-4c4d-83eb-11b23fd6624f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5d0721-0830-46b5-8de7-69301fde308e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:06 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:23:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16a816-e677-455c-817b-8f799d1d2aee]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG os_brick.utils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:06 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Updating existing volume attachment record: c39b40b1-b035-4693-86de-1809a27bbde0 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:23:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:08 user nova-compute[75255]: WARNING nova.compute.manager [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received unexpected event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with vm_state building and task_state spawning.
Nov 14 11:23:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:08 user nova-compute[75255]: WARNING nova.compute.manager [req-484a78c6-1aa1-4bc3-aaba-f204338788e2 req-9bb456b1-0d79-4cbc-85eb-969e14d4ddb5 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received unexpected event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with vm_state building and task_state spawning.
Nov 14 11:23:09 user nova-compute[75255]: DEBUG os_brick.utils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cbe4f6-c502-4403-a07c-2740a700ac22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d35831-b89a-4efd-8e45-235a6cb3976e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f406c5-eed2-48b8-8b20-4e42d6fd374d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2326491-e377-45c6-81cc-93142a0dc461]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:23:09 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a355e17-d42c-42e9-86e2-8c9188944080]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG os_brick.utils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Updating existing volume attachment record: a6254d36-7883-45bf-9d1a-87893773f47d {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:23:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance spawned successfully.
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:09 user nova-compute[75255]: INFO nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'pci_requests' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'numa_topology' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:09 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:23:09 user nova-compute[75255]: INFO nova.compute.claims [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Claim successful on node user
Nov 14 11:23:09 user nova-compute[75255]: INFO nova.compute.manager [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Took 10.36 seconds to build instance.
Nov 14 11:23:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-92424668-be53-4a52-90f5-1dd589be9607 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.498s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:10 user nova-compute[75255]: INFO nova.network.neutron [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating port 7a833ede-1eff-4e41-89ff-72ecc27b25bb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing instance network info cache due to event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:23:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHVjLBXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:11 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:11 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:11 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e5d412-88d7-4986-a70c-80c716d23081]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:23:11 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a516baf8-898d-4840-b914-b4c031cec86d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3] added
Nov 14 11:23:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc87c28-4864-4cdb-845a-c49051bd4f9e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60d4452-6eaf-4711-a2a6-b20cdd3a209f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHVjLBXY {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHVjLBXY" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bae4c50-571a-432c-a593-98a8307128ce]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uHVjLBXY'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e19fc6-e1db-41b1-803e-91939a18fac7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c7929c-7aec-4770-9ecc-190c03558b9a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:11 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:11 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:23:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Creating image(s)
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Ensure instance console log exists: /opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Start _get_guest_xml network_info=[{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd488d964-ea21-460d-8023-fafdde6db123', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68bca729-db5f-4edd-9549-979c5b00e49b', 'attached_at': '', 'detached_at': '', 'volume_id': '48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'serial': '48fbc53d-534d-4d32-8319-6cc35b8cf74b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.network.neutron [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:23:11 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:11 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5763419-e7ee-486c-83dd-7b0dbeb5c805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260]
Nov 14 11:23:11 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260] successful.
Nov 14 11:23:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89cf11f-688e-4de9-acda-5bb18ce65e4c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Object Instance<68bca729-db5f-4edd-9549-979c5b00e49b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:11 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[754ac6bc-897e-4e6a-9d62-619f60e65a51]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:11 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:11 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:11 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:11 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89754fd-8206-46c8-9840-d7083a359e08]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:23:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHVjLBXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updated VIF entry in instance network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-be813080-a467-4bd8-a5a8-9a7b63ad7727 req-52dd05f9-cb8d-495b-84e0-a877f07a0d2d service nova] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:12 user nova-compute[75255]: INFO nova.compute.manager [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Terminating instance
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-4a614b2a-5ecd-47de-ad6a-83c9cbcd19ec req-cd1a61f5-f269-449a-a3a1-44eb12579a9b service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4a614b2a-5ecd-47de-ad6a-83c9cbcd19ec req-cd1a61f5-f269-449a-a3a1-44eb12579a9b service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4a614b2a-5ecd-47de-ad6a-83c9cbcd19ec req-cd1a61f5-f269-449a-a3a1-44eb12579a9b service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4a614b2a-5ecd-47de-ad6a-83c9cbcd19ec req-cd1a61f5-f269-449a-a3a1-44eb12579a9b service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-4a614b2a-5ecd-47de-ad6a-83c9cbcd19ec req-cd1a61f5-f269-449a-a3a1-44eb12579a9b service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-4a614b2a-5ecd-47de-ad6a-83c9cbcd19ec req-cd1a61f5-f269-449a-a3a1-44eb12579a9b service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-unplugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26661353066303839', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661353066303839', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.038s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:12 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:12 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'flavor' on Instance uuid bd25e139-e7bc-4e57-a8d9-e248b444fae3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f27c3a-9a34-45e5-8ea6-1fb321a3faed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:23:12 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:23:12 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:23:12 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:23:12 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:23:12 user nova-compute[75255]:   <serial>f79dfa08-66e4-4e97-8cde-948b4d60b3d3</serial>
Nov 14 11:23:12 user nova-compute[75255]: </disk>
Nov 14 11:23:12 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01fc4a-7713-4165-b2cb-0c2711ab82db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b] added
Nov 14 11:23:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427e817-9646-46cc-850e-4143aa3f8182]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d08bb08-5ca7-450d-8c6a-a6084f15ce6e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWxZBNVU {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWxZBNVU" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[142389b6-44b4-4af7-892c-d7ce4b430e80]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wWxZBNVU'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b94988-102a-4b30-af05-f36162ca0180]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[840180b7-d281-4837-9b47-2e17676bd8e1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:12 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:12 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:12 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:12 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff7ff3a-dde3-45d8-a3f3-27c77c4c300a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]
Nov 14 11:23:13 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.
Nov 14 11:23:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8bc65b-1aca-4550-ae38-5fcd32016544]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acfec76-240a-48e5-8cee-565c00fb8039]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:13 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:13 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:13 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:13 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:13 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:13 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:13 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89342ea-44ef-4beb-b461-8cdbe01e9678]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:23:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Instance destroyed successfully.
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lazy-loading 'resources' on Instance uuid ddc1e1f7-468c-411d-8406-4f22bf7b457b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-893880233',display_name='tempest-ServerStableDeviceRescueTest-server-893880233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-893880233',id=26,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvjm3mfZ3A1nuCZmbZ6DHT/v2SGbBbRTQ3rTSIMUmz2mJmOvLPnIXv0X38Y8d6CK5rqaKiD1dGcVRZtgMtuEvRpU8NWVcWg1sDGBjTB9suOOCGfZl5rX+FZPbfuqYw4Mw==',key_name='tempest-keypair-1355669994',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:20:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49a5377fc1334955bebb27aeeecdcdff',ramdisk_id='',reservation_id='r-d424vfs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-686352298',owner_user_name='tempest-ServerStableDeviceRescueTest-686352298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7197d75a463840b38c24f31bda6b5ea2',uuid=ddc1e1f7-468c-411d-8406-4f22bf7b457b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converting VIF {"id": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "address": "fa:16:3e:d0:5f:5a", "network": {"id": "5a16865e-a3f8-419d-baac-5e55c6e2b378", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-347132506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49a5377fc1334955bebb27aeeecdcdff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff2a1b6-c7", "ovs_interfaceid": "7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG os_vif [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ff2a1b6-c7, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fee3d465-4d04-426f-9a1b-ce378de3aae1) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:13 user nova-compute[75255]: INFO os_vif [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5f:5a,bridge_name='br-int',has_traffic_filtering=True,id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3,network=Network(5a16865e-a3f8-419d-baac-5e55c6e2b378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff2a1b6-c7')
Nov 14 11:23:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Deleting instance files /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b_del
Nov 14 11:23:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Deletion of /opt/stack/data/nova/instances/ddc1e1f7-468c-411d-8406-4f22bf7b457b_del complete
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No VIF found with MAC fa:16:3e:06:99:05, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:23:13 user nova-compute[75255]: INFO nova.compute.manager [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:23:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e757fed-e653-47fc-af5a-ce950f717921 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.054s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] <== connect_volume: return (2425ms) {'type': 'block', 'scsi_wwn': '23832303062393535', 'path': '/dev/sde'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832303062393535', 'path': '/dev/sde'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-805539077',display_name='tempest-TestShelveInstance-server-805539077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-805539077',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-287110248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='14b5b339310242ea8837a4a3ffee6532',ramdisk_id='',reservation_id='r-g6gjeea3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1188210100',owner_user_name='tempest-TestShelveInstance-1188210100-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:23:05Z,user_data=None,user_id='0a68d5e2b8b64a289abf08bba42e1033',uuid=68bca729-db5f-4edd-9549-979c5b00e49b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converting VIF {"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'pci_devices' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Object Instance<68bca729-db5f-4edd-9549-979c5b00e49b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:23:14 user nova-compute[75255]:   <uuid>68bca729-db5f-4edd-9549-979c5b00e49b</uuid>
Nov 14 11:23:14 user nova-compute[75255]:   <name>instance-0000001d</name>
Nov 14 11:23:14 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:23:14 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:23:14 user nova-compute[75255]:   <metadata>
Nov 14 11:23:14 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:23:14 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:23:14 user nova-compute[75255]:       <nova:name>tempest-TestShelveInstance-server-805539077</nova:name>
Nov 14 11:23:14 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:23:11</nova:creationTime>
Nov 14 11:23:14 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:23:14 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:23:14 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:23:14 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:23:14 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:23:14 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:23:14 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:23:14 user nova-compute[75255]:       <nova:owner>
Nov 14 11:23:14 user nova-compute[75255]:         <nova:user uuid="0a68d5e2b8b64a289abf08bba42e1033">tempest-TestShelveInstance-1188210100-project-member</nova:user>
Nov 14 11:23:14 user nova-compute[75255]:         <nova:project uuid="14b5b339310242ea8837a4a3ffee6532">tempest-TestShelveInstance-1188210100</nova:project>
Nov 14 11:23:14 user nova-compute[75255]:       </nova:owner>
Nov 14 11:23:14 user nova-compute[75255]:       <nova:ports>
Nov 14 11:23:14 user nova-compute[75255]:         <nova:port uuid="7a833ede-1eff-4e41-89ff-72ecc27b25bb">
Nov 14 11:23:14 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:23:14 user nova-compute[75255]:         </nova:port>
Nov 14 11:23:14 user nova-compute[75255]:       </nova:ports>
Nov 14 11:23:14 user nova-compute[75255]:     </nova:instance>
Nov 14 11:23:14 user nova-compute[75255]:   </metadata>
Nov 14 11:23:14 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:23:14 user nova-compute[75255]:     <system>
Nov 14 11:23:14 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:23:14 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:23:14 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:23:14 user nova-compute[75255]:       <entry name="serial">68bca729-db5f-4edd-9549-979c5b00e49b</entry>
Nov 14 11:23:14 user nova-compute[75255]:       <entry name="uuid">68bca729-db5f-4edd-9549-979c5b00e49b</entry>
Nov 14 11:23:14 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:23:14 user nova-compute[75255]:     </system>
Nov 14 11:23:14 user nova-compute[75255]:   </sysinfo>
Nov 14 11:23:14 user nova-compute[75255]:   <os>
Nov 14 11:23:14 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:23:14 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:23:14 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:23:14 user nova-compute[75255]:   </os>
Nov 14 11:23:14 user nova-compute[75255]:   <features>
Nov 14 11:23:14 user nova-compute[75255]:     <acpi/>
Nov 14 11:23:14 user nova-compute[75255]:     <apic/>
Nov 14 11:23:14 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:23:14 user nova-compute[75255]:   </features>
Nov 14 11:23:14 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:23:14 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:23:14 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:23:14 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:23:14 user nova-compute[75255]:   </clock>
Nov 14 11:23:14 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:23:14 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:23:14 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:23:14 user nova-compute[75255]:   </cpu>
Nov 14 11:23:14 user nova-compute[75255]:   <devices>
Nov 14 11:23:14 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:23:14 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:23:14 user nova-compute[75255]:       <source dev="/dev/sde"/>
Nov 14 11:23:14 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:23:14 user nova-compute[75255]:       <serial>48fbc53d-534d-4d32-8319-6cc35b8cf74b</serial>
Nov 14 11:23:14 user nova-compute[75255]:     </disk>
Nov 14 11:23:14 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:23:14 user nova-compute[75255]:       <mac address="fa:16:3e:a4:eb:ca"/>
Nov 14 11:23:14 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:23:14 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:23:14 user nova-compute[75255]:       <target dev="tap7a833ede-1e"/>
Nov 14 11:23:14 user nova-compute[75255]:     </interface>
Nov 14 11:23:14 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:23:14 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b/console.log" append="off"/>
Nov 14 11:23:14 user nova-compute[75255]:     </serial>
Nov 14 11:23:14 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:23:14 user nova-compute[75255]:     <video>
Nov 14 11:23:14 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:23:14 user nova-compute[75255]:     </video>
Nov 14 11:23:14 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:23:14 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:23:14 user nova-compute[75255]:     </rng>
Nov 14 11:23:14 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:23:14 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:23:14 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:23:14 user nova-compute[75255]:     </memballoon>
Nov 14 11:23:14 user nova-compute[75255]:   </devices>
Nov 14 11:23:14 user nova-compute[75255]: </domain>
Nov 14 11:23:14 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-805539077',display_name='tempest-TestShelveInstance-server-805539077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-805539077',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-287110248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='14b5b339310242ea8837a4a3ffee6532',ramdisk_id='',reservation_id='r-g6gjeea3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1188210100',owner_user_name='tempest-TestShelveInstance-1188210100-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:23:05Z,user_data=None,user_id='0a68d5e2b8b64a289abf08bba42e1033',uuid=68bca729-db5f-4edd-9549-979c5b00e49b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converting VIF {"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_vif [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35f24afb-8f32-5cbf-87a4-b360018d8062', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a833ede-1e, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a833ede-1e, col_values=(('qos', UUID('c3d4102b-a5ee-4f88-b48e-d69d3051ce65')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a833ede-1e, col_values=(('external_ids', {'iface-id': '7a833ede-1eff-4e41-89ff-72ecc27b25bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:eb:ca', 'vm-uuid': '68bca729-db5f-4edd-9549-979c5b00e49b'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:14 user nova-compute[75255]: INFO os_vif [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e')
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] No VIF found with MAC fa:16:3e:a4:eb:ca, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-2facffb3-1253-419f-b477-f279f99a989a req-7200d11f-af30-44ac-bc90-03f21cce73a5 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-deleted-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:14 user nova-compute[75255]: INFO nova.compute.manager [req-2facffb3-1253-419f-b477-f279f99a989a req-7200d11f-af30-44ac-bc90-03f21cce73a5 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Neutron deleted interface 7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3; detaching it from the instance and deleting it from the info cache
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-2facffb3-1253-419f-b477-f279f99a989a req-7200d11f-af30-44ac-bc90-03f21cce73a5 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:14 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Took 0.86 seconds to deallocate network for instance.
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-2facffb3-1253-419f-b477-f279f99a989a req-7200d11f-af30-44ac-bc90-03f21cce73a5 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Detach interface failed, port_id=7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3, reason: Instance ddc1e1f7-468c-411d-8406-4f22bf7b457b could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:23:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Creating image(s)
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Ensure instance console log exists: /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Start _get_guest_xml network_info=[{"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'a6254d36-7883-45bf-9d1a-87893773f47d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPvybpSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae76487b-9360-43d4-b081-68186acc2565', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'serial': 'ac19eea3-84bb-4271-bec4-e8d4b409ffd1'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:23:14 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:14 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPvybpSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:14 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:14 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:14 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a1a4a-9d08-44ee-b2dc-c6c7b41cef0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-74997171-152d-472a-a7a1-fb243f0f12e6 req-def53d0f-b057-4647-b8f4-6ed9d32cb1a9 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-74997171-152d-472a-a7a1-fb243f0f12e6 req-def53d0f-b057-4647-b8f4-6ed9d32cb1a9 service nova] Acquiring lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-74997171-152d-472a-a7a1-fb243f0f12e6 req-def53d0f-b057-4647-b8f4-6ed9d32cb1a9 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-74997171-152d-472a-a7a1-fb243f0f12e6 req-def53d0f-b057-4647-b8f4-6ed9d32cb1a9 service nova] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-74997171-152d-472a-a7a1-fb243f0f12e6 req-def53d0f-b057-4647-b8f4-6ed9d32cb1a9 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] No waiting events found dispatching network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:14 user nova-compute[75255]: WARNING nova.compute.manager [req-74997171-152d-472a-a7a1-fb243f0f12e6 req-def53d0f-b057-4647-b8f4-6ed9d32cb1a9 service nova] [instance: ddc1e1f7-468c-411d-8406-4f22bf7b457b] Received unexpected event network-vif-plugged-7ff2a1b6-c7ef-4b25-90d9-6c828fb215f3 for instance with vm_state deleted and task_state None.
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:23:14 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b23c214-9372-4f6f-bced-f0a970113614]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1] added
Nov 14 11:23:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf43cab2-ab07-4e53-913d-de251d7400b3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b40f1f-daf1-4eb5-8787-3836c5d71d1d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPvybpSQ {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPvybpSQ" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[581b8a03-e9ec-4f60-a185-62f6a0a3cfef]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aPvybpSQ'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e78277-5ae6-4c3d-9213-8fae309100ec]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c5f8d-640c-4695-93db-0d897a48b033]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:14 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:14 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:14 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:14 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:14 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:14 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:14 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a07ccec-1d69-4975-85ca-509e010f6462]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260]
Nov 14 11:23:15 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260] successful.
Nov 14 11:23:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6ba0e8-fe00-4055-8bf7-13cc672b98d1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:15 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Deleted allocations for instance ddc1e1f7-468c-411d-8406-4f22bf7b457b
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[59227506-d151-41a4-91d1-2b3b12228c96]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:23:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:15 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:23:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d5f3a-152e-434b-98a3-b9e3b8b3736b]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPvybpSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ae1c9b25-ef3c-4297-9a4b-f9790dc7ce9d tempest-ServerStableDeviceRescueTest-686352298 tempest-ServerStableDeviceRescueTest-686352298-project-member] Lock "ddc1e1f7-468c-411d-8406-4f22bf7b457b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.897s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:15 user nova-compute[75255]: INFO nova.compute.manager [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Terminating instance
Nov 14 11:23:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-232b0eb2-1ff7-481f-9e66-945dea7e4864 req-76d205fc-a40e-45ca-b83b-90c262c3a04f service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-232b0eb2-1ff7-481f-9e66-945dea7e4864 req-76d205fc-a40e-45ca-b83b-90c262c3a04f service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-232b0eb2-1ff7-481f-9e66-945dea7e4864 req-76d205fc-a40e-45ca-b83b-90c262c3a04f service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-232b0eb2-1ff7-481f-9e66-945dea7e4864 req-76d205fc-a40e-45ca-b83b-90c262c3a04f service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-232b0eb2-1ff7-481f-9e66-945dea7e4864 req-76d205fc-a40e-45ca-b83b-90c262c3a04f service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:15 user nova-compute[75255]: WARNING nova.compute.manager [req-232b0eb2-1ff7-481f-9e66-945dea7e4864 req-76d205fc-a40e-45ca-b83b-90c262c3a04f service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received unexpected event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 11:23:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23232323032616235', 'path': '/dev/sdf'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232323032616235', 'path': '/dev/sdf'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369322017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369322017',id=33,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-1j5wk6bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:23:04Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=ae76487b-9360-43d4-b081-68186acc2565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'pci_devices' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:23:16 user nova-compute[75255]:   <uuid>ae76487b-9360-43d4-b081-68186acc2565</uuid>
Nov 14 11:23:16 user nova-compute[75255]:   <name>instance-00000021</name>
Nov 14 11:23:16 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:23:16 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:23:16 user nova-compute[75255]:   <metadata>
Nov 14 11:23:16 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:23:16 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:23:16 user nova-compute[75255]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1369322017</nova:name>
Nov 14 11:23:16 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:23:14</nova:creationTime>
Nov 14 11:23:16 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:23:16 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:23:16 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:23:16 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:23:16 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:23:16 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:23:16 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:23:16 user nova-compute[75255]:       <nova:owner>
Nov 14 11:23:16 user nova-compute[75255]:         <nova:user uuid="3b82af4602b649889188f0f943c63896">tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member</nova:user>
Nov 14 11:23:16 user nova-compute[75255]:         <nova:project uuid="bbb07eaf3ea24939aeef6eba1bb2293d">tempest-ServerBootFromVolumeStableRescueTest-1912178200</nova:project>
Nov 14 11:23:16 user nova-compute[75255]:       </nova:owner>
Nov 14 11:23:16 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:23:16 user nova-compute[75255]:       <nova:ports>
Nov 14 11:23:16 user nova-compute[75255]:         <nova:port uuid="5962caa2-9c61-4cf6-bd36-0b9fc6153aed">
Nov 14 11:23:16 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:23:16 user nova-compute[75255]:         </nova:port>
Nov 14 11:23:16 user nova-compute[75255]:       </nova:ports>
Nov 14 11:23:16 user nova-compute[75255]:     </nova:instance>
Nov 14 11:23:16 user nova-compute[75255]:   </metadata>
Nov 14 11:23:16 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:23:16 user nova-compute[75255]:     <system>
Nov 14 11:23:16 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:23:16 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:23:16 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:23:16 user nova-compute[75255]:       <entry name="serial">ae76487b-9360-43d4-b081-68186acc2565</entry>
Nov 14 11:23:16 user nova-compute[75255]:       <entry name="uuid">ae76487b-9360-43d4-b081-68186acc2565</entry>
Nov 14 11:23:16 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:23:16 user nova-compute[75255]:     </system>
Nov 14 11:23:16 user nova-compute[75255]:   </sysinfo>
Nov 14 11:23:16 user nova-compute[75255]:   <os>
Nov 14 11:23:16 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:23:16 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:23:16 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:23:16 user nova-compute[75255]:   </os>
Nov 14 11:23:16 user nova-compute[75255]:   <features>
Nov 14 11:23:16 user nova-compute[75255]:     <acpi/>
Nov 14 11:23:16 user nova-compute[75255]:     <apic/>
Nov 14 11:23:16 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:23:16 user nova-compute[75255]:   </features>
Nov 14 11:23:16 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:23:16 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:23:16 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:23:16 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:23:16 user nova-compute[75255]:   </clock>
Nov 14 11:23:16 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:23:16 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:23:16 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:23:16 user nova-compute[75255]:   </cpu>
Nov 14 11:23:16 user nova-compute[75255]:   <devices>
Nov 14 11:23:16 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:23:16 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:23:16 user nova-compute[75255]:       <source dev="/dev/sdf"/>
Nov 14 11:23:16 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:23:16 user nova-compute[75255]:       <serial>ac19eea3-84bb-4271-bec4-e8d4b409ffd1</serial>
Nov 14 11:23:16 user nova-compute[75255]:     </disk>
Nov 14 11:23:16 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:23:16 user nova-compute[75255]:       <mac address="fa:16:3e:e4:2e:93"/>
Nov 14 11:23:16 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:23:16 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:23:16 user nova-compute[75255]:       <target dev="tap5962caa2-9c"/>
Nov 14 11:23:16 user nova-compute[75255]:     </interface>
Nov 14 11:23:16 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:23:16 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/console.log" append="off"/>
Nov 14 11:23:16 user nova-compute[75255]:     </serial>
Nov 14 11:23:16 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:23:16 user nova-compute[75255]:     <video>
Nov 14 11:23:16 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:23:16 user nova-compute[75255]:     </video>
Nov 14 11:23:16 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:23:16 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:23:16 user nova-compute[75255]:     </rng>
Nov 14 11:23:16 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:23:16 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:23:16 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:23:16 user nova-compute[75255]:     </memballoon>
Nov 14 11:23:16 user nova-compute[75255]:   </devices>
Nov 14 11:23:16 user nova-compute[75255]: </domain>
Nov 14 11:23:16 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369322017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369322017',id=33,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-1j5wk6bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:23:04Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=ae76487b-9360-43d4-b081-68186acc2565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG os_vif [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '080d9f80-3c64-528b-91b2-aec9d39b482a', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5962caa2-9c, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5962caa2-9c, col_values=(('qos', UUID('1a9ffa27-222d-4e31-84c0-6fe1d92f4445')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5962caa2-9c, col_values=(('external_ids', {'iface-id': '5962caa2-9c61-4cf6-bd36-0b9fc6153aed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:2e:93', 'vm-uuid': 'ae76487b-9360-43d4-b081-68186acc2565'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Instance destroyed successfully.
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lazy-loading 'resources' on Instance uuid 943d1e23-bb99-4499-83db-eca996c3fedf {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: INFO os_vif [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c')
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461046809',display_name='tempest-ServerRescueNegativeTestJSON-server-1461046809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461046809',id=1,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a3c374e68a4ec483ff0a15298b1bff',ramdisk_id='',reservation_id='r-yvdv1q6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135406154',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135406154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:13:04Z,user_data=None,user_id='13c7ed01376d41ac9b99ba698909e8bf',uuid=943d1e23-bb99-4499-83db-eca996c3fedf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converting VIF {"id": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "address": "fa:16:3e:f7:c9:63", "network": {"id": "1caff847-76aa-4057-ba02-1c8e4a45a2b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1758192863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a3c374e68a4ec483ff0a15298b1bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7853a5a2-53", "ovs_interfaceid": "7853a5a2-5301-4337-a5a4-6bcddf944f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG os_vif [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7853a5a2-53, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac405d98-0733-47b1-994b-8b252b3e7dc6) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: INFO os_vif [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=7853a5a2-5301-4337-a5a4-6bcddf944f11,network=Network(1caff847-76aa-4057-ba02-1c8e4a45a2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7853a5a2-53')
Nov 14 11:23:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Deleting instance files /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf_del
Nov 14 11:23:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Deletion of /opt/stack/data/nova/instances/943d1e23-bb99-4499-83db-eca996c3fedf_del complete
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No VIF found with MAC fa:16:3e:e4:2e:93, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: INFO nova.compute.manager [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-unplugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] Acquiring lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] Lock "943d1e23-bb99-4499-83db-eca996c3fedf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] No waiting events found dispatching network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:16 user nova-compute[75255]: WARNING nova.compute.manager [req-a85806ba-f115-4c4b-943e-af37affd3569 req-74d93f02-a79b-49e3-b9c4-f15c7595a86b service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received unexpected event network-vif-plugged-7853a5a2-5301-4337-a5a4-6bcddf944f11 for instance with vm_state active and task_state deleting.
Nov 14 11:23:16 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:16 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Took 0.48 seconds to deallocate network for instance.
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:17 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Deleted allocations for instance 943d1e23-bb99-4499-83db-eca996c3fedf
Nov 14 11:23:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-302afd09-35a4-4475-8775-8dce2d856ced tempest-ServerRescueNegativeTestJSON-2135406154 tempest-ServerRescueNegativeTestJSON-2135406154-project-member] Lock "943d1e23-bb99-4499-83db-eca996c3fedf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.046s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-41cd346b-eb63-43f1-81a1-a2b3ceb6d461 req-fc2792c4-5f70-40dc-9388-784c7b0ba703 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41cd346b-eb63-43f1-81a1-a2b3ceb6d461 req-fc2792c4-5f70-40dc-9388-784c7b0ba703 service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41cd346b-eb63-43f1-81a1-a2b3ceb6d461 req-fc2792c4-5f70-40dc-9388-784c7b0ba703 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-41cd346b-eb63-43f1-81a1-a2b3ceb6d461 req-fc2792c4-5f70-40dc-9388-784c7b0ba703 service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-41cd346b-eb63-43f1-81a1-a2b3ceb6d461 req-fc2792c4-5f70-40dc-9388-784c7b0ba703 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:17 user nova-compute[75255]: WARNING nova.compute.manager [req-41cd346b-eb63-43f1-81a1-a2b3ceb6d461 req-fc2792c4-5f70-40dc-9388-784c7b0ba703 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received unexpected event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 11:23:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:23:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:23:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance spawned successfully.
Nov 14 11:23:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:23:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ba458ae-12a2-4baf-a49a-eb345b1104f4 tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.982s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-a56e4636-8550-45b5-ae74-030ee4dedd5f req-dc98f1d3-abfe-4d50-a21f-197648dfe1c5 service nova] [instance: 943d1e23-bb99-4499-83db-eca996c3fedf] Received event network-vif-deleted-7853a5a2-5301-4337-a5a4-6bcddf944f11 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:23:19 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance spawned successfully.
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:23:20 user nova-compute[75255]: INFO nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 11:23:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:20 user nova-compute[75255]: WARNING nova.compute.manager [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state building and task_state spawning.
Nov 14 11:23:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:20 user nova-compute[75255]: WARNING nova.compute.manager [req-0f4cfddc-ae17-459d-986c-40fdfc815fbf req-82a8378a-e47b-4b6f-8f00-34493be1b1ec service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state building and task_state spawning.
Nov 14 11:23:20 user nova-compute[75255]: INFO nova.compute.manager [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Took 16.79 seconds to build instance.
Nov 14 11:23:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-108e5339-cc6c-4fdc-8321-ff2690e1df34 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "ae76487b-9360-43d4-b081-68186acc2565" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.879s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:21 user nova-compute[75255]: INFO nova.compute.manager [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Detaching volume f79dfa08-66e4-4e97-8cde-948b4d60b3d3
Nov 14 11:23:22 user nova-compute[75255]: INFO nova.virt.block_device [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Attempting to driver detach volume f79dfa08-66e4-4e97-8cde-948b4d60b3d3 from mountpoint /dev/vdb
Nov 14 11:23:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Attempting to detach device vdb from instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:23:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:23:22 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:23:22 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:23:22 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:23:22 user nova-compute[75255]:   <serial>f79dfa08-66e4-4e97-8cde-948b4d60b3d3</serial>
Nov 14 11:23:22 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:23:22 user nova-compute[75255]: </disk>
Nov 14 11:23:22 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:23:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully detached device vdb from instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 from the persistent domain config.
Nov 14 11:23:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:23:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:23:22 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:23:22 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:23:22 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:23:22 user nova-compute[75255]:   <serial>f79dfa08-66e4-4e97-8cde-948b4d60b3d3</serial>
Nov 14 11:23:22 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:23:22 user nova-compute[75255]: </disk>
Nov 14 11:23:22 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:23:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:23:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:23:38 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:23:40 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:40 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=25.13702392578125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ae76487b-9360-43d4-b081-68186acc2565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 68bca729-db5f-4edd-9549-979c5b00e49b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:23:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:42 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 is timed out.
Nov 14 11:23:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully detached device vdb from instance bd25e139-e7bc-4e57-a8d9-e248b444fae3 from the live domain config.
Nov 14 11:23:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHVjLBXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:42 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ef8d6-66fd-4bf0-9bc8-75b2beb25017]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:23:42 user nova-compute[75255]: No targets found.
Nov 14 11:23:42 user nova-compute[75255]: iSNS:
Nov 14 11:23:42 user nova-compute[75255]: No targets found.
Nov 14 11:23:42 user nova-compute[75255]: STATIC:
Nov 14 11:23:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:23:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b
Nov 14 11:23:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:23:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3
Nov 14 11:23:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:42 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:23:42 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:42 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:42 user nova-compute[75255]: FIRMWARE:
Nov 14 11:23:42 user nova-compute[75255]: No targets found.
Nov 14 11:23:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:23:42 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:23:42 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b968248-9b9b-4d21-b49f-cec4ceb8555a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3bc07e-3716-44c7-85a5-06f0ced9b833]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:23:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:42 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:23:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff328581ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2173d3-aa42-4dfa-b5fe-80ea24797fff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c83cb1-4479-4073-bfc0-9499b6522797]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[576d963c-869f-40ea-87e6-7cf4e1225cb4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d9ba4f-f2fb-46fd-8e20-340ae3363c95]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c80814-ef4b-4406-a20a-bc05e78297cf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d252f0-eb67-47a8-948f-39c29c3f0109]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260]
Nov 14 11:23:42 user nova-compute[75255]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3, portal: 172.16.0.220,3260] successful.
Nov 14 11:23:42 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b07621-a377-47df-8dc1-11c3794d88cf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== disconnect_volume: return (346ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:23:43 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'flavor' on Instance uuid bd25e139-e7bc-4e57-a8d9-e248b444fae3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e6b6a64b-d20d-4e4d-bda3-1d747b289bc3 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.131s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.011s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:44 user nova-compute[75255]: INFO nova.compute.manager [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Terminating instance
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-fc973dfd-74c4-466b-9843-5bb66e9bcb20 req-6f14994d-8909-4913-becb-80be7fa7f58e service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-vif-unplugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fc973dfd-74c4-466b-9843-5bb66e9bcb20 req-6f14994d-8909-4913-becb-80be7fa7f58e service nova] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fc973dfd-74c4-466b-9843-5bb66e9bcb20 req-6f14994d-8909-4913-becb-80be7fa7f58e service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fc973dfd-74c4-466b-9843-5bb66e9bcb20 req-6f14994d-8909-4913-becb-80be7fa7f58e service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-fc973dfd-74c4-466b-9843-5bb66e9bcb20 req-6f14994d-8909-4913-becb-80be7fa7f58e service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] No waiting events found dispatching network-vif-unplugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-fc973dfd-74c4-466b-9843-5bb66e9bcb20 req-6f14994d-8909-4913-becb-80be7fa7f58e service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-vif-unplugged-af27f923-fba8-4b30-a59b-c05c323997b8 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Instance destroyed successfully.
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'resources' on Instance uuid bd25e139-e7bc-4e57-a8d9-e248b444fae3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1924753918',display_name='tempest-VolumesSnapshotTestJSON-instance-1924753918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1924753918',id=31,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCXtsOwwIYl4EyBsg7s/hxN14bNS+0rBoCRWcRjZGwKgaC01s7QJeM2VcIk3Fa9fOtZEdFEITKQ2YLjNeRFEIOMejo93G/QFICnVMjRaJgdXXU1aCOUFjEOKkgfUSD11Q==',key_name='tempest-keypair-1164911972',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ddf20982f454dd4a1c831e064b41ec6',ramdisk_id='',reservation_id='r-i8cdeha1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-610019682',owner_user_name='tempest-VolumesSnapshotTestJSON-610019682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:21:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d356b8218514e458c45ec3066bad892',uuid=bd25e139-e7bc-4e57-a8d9-e248b444fae3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converting VIF {"id": "af27f923-fba8-4b30-a59b-c05c323997b8", "address": "fa:16:3e:06:99:05", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf27f923-fb", "ovs_interfaceid": "af27f923-fba8-4b30-a59b-c05c323997b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:99:05,bridge_name='br-int',has_traffic_filtering=True,id=af27f923-fba8-4b30-a59b-c05c323997b8,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf27f923-fb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_vif [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:99:05,bridge_name='br-int',has_traffic_filtering=True,id=af27f923-fba8-4b30-a59b-c05c323997b8,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf27f923-fb') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf27f923-fb, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=167b1d16-af49-40e7-8d91-b8971e99c253) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:23:44 user nova-compute[75255]: INFO os_vif [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:99:05,bridge_name='br-int',has_traffic_filtering=True,id=af27f923-fba8-4b30-a59b-c05c323997b8,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf27f923-fb')
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHVjLBXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:23:44 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b6d101-4ee7-4497-ac15-29cf56e13b14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:23:44 user nova-compute[75255]: No targets found.
Nov 14 11:23:44 user nova-compute[75255]: iSNS:
Nov 14 11:23:44 user nova-compute[75255]: No targets found.
Nov 14 11:23:44 user nova-compute[75255]: STATIC:
Nov 14 11:23:44 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:23:44 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:44 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:44 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b
Nov 14 11:23:44 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:44 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:44 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:23:44 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:44 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:44 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:23:44 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:23:44 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:23:44 user nova-compute[75255]: FIRMWARE:
Nov 14 11:23:44 user nova-compute[75255]: No targets found.
Nov 14 11:23:44 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:23:44 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:23:44 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f79dfa08-66e4-4e97-8cde-948b4d60b3d3', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca87e4f8-1282-47c9-ba07-0cce4c1074a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6e16b-36dd-4393-ae82-e327f10db084]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:44 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:44 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:44 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:23:44 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:23:44 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:23:44 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:23:44 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:23:44 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086dde10>, {}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Disconnecting from: [] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== disconnect_volume: return (74ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:23:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Deleting instance files /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3_del
Nov 14 11:23:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Deletion of /opt/stack/data/nova/instances/bd25e139-e7bc-4e57-a8d9-e248b444fae3_del complete
Nov 14 11:23:44 user nova-compute[75255]: INFO nova.compute.manager [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 11:23:44 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:23:44 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:23:45 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:23:45 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Took 0.64 seconds to deallocate network for instance.
Nov 14 11:23:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-5126b282-22d5-48f7-b316-930e2b585543 req-05037eb3-5a51-4241-aef7-37a41d256bd1 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-vif-deleted-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:45 user nova-compute[75255]: WARNING nova.volume.cinder [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Attachment c39b40b1-b035-4693-86de-1809a27bbde0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c39b40b1-b035-4693-86de-1809a27bbde0. (HTTP 404) (Request-ID: req-75d1c0c1-f93c-4997-87bf-6cf6a3ad3adc)
Nov 14 11:23:45 user nova-compute[75255]: INFO nova.compute.manager [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 11:23:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:46 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Deleted allocations for instance bd25e139-e7bc-4e57-a8d9-e248b444fae3
Nov 14 11:23:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7f0a17a4-600f-4a66-ae50-e33a296d2042 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-49db82e9-5435-465a-9d79-2effabec3026 req-68231e27-f898-4685-bd00-c84a6c0e9f36 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received event network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-49db82e9-5435-465a-9d79-2effabec3026 req-68231e27-f898-4685-bd00-c84a6c0e9f36 service nova] Acquiring lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-49db82e9-5435-465a-9d79-2effabec3026 req-68231e27-f898-4685-bd00-c84a6c0e9f36 service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-49db82e9-5435-465a-9d79-2effabec3026 req-68231e27-f898-4685-bd00-c84a6c0e9f36 service nova] Lock "bd25e139-e7bc-4e57-a8d9-e248b444fae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:23:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-49db82e9-5435-465a-9d79-2effabec3026 req-68231e27-f898-4685-bd00-c84a6c0e9f36 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] No waiting events found dispatching network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:23:46 user nova-compute[75255]: WARNING nova.compute.manager [req-49db82e9-5435-465a-9d79-2effabec3026 req-68231e27-f898-4685-bd00-c84a6c0e9f36 service nova] [instance: bd25e139-e7bc-4e57-a8d9-e248b444fae3] Received unexpected event network-vif-plugged-af27f923-fba8-4b30-a59b-c05c323997b8 for instance with vm_state deleted and task_state None.
Nov 14 11:23:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:23:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:23:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:23:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:23:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:24:19 user nova-compute[75255]: INFO nova.compute.claims [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Claim successful on node user
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.network.neutron [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:19 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.policy [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b4b049ae1654b4495e42b8ec2cb11f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539e7facdc2a4ce081fa5eff222d0193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:24:19 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Creating image(s)
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk 1073741824" returned: 0 in 0.063s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.204s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Cannot resize image /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Ensure instance console log exists: /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:20 user nova-compute[75255]: DEBUG nova.network.neutron [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Successfully created port: be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Successfully updated port: be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing instance network info cache due to event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.neutron [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance network_info: |[{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.neutron [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Start _get_guest_xml network_info=[{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:24:21 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:21 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984960086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984960086',id=34,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkig5pg750P4RIFQnqNLC/Mj9a0A19astPZfi6byTXL6e6EfI3unEeWVANHnucwQKGZRidB6ciCLZOg4qqyrZIl6EnDHhsUbPcN08n0FQuCBZRCo7ozmRH+1BoerVVygA==',key_name='tempest-keypair-1100144298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-90adzxhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=7976be6c-afb4-4ddf-ac33-ddbd8a23265e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.objects.instance [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'pci_devices' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:24:21 user nova-compute[75255]:   <uuid>7976be6c-afb4-4ddf-ac33-ddbd8a23265e</uuid>
Nov 14 11:24:21 user nova-compute[75255]:   <name>instance-00000022</name>
Nov 14 11:24:21 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:24:21 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:24:21 user nova-compute[75255]:   <metadata>
Nov 14 11:24:21 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:24:21 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:24:21 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1984960086</nova:name>
Nov 14 11:24:21 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:24:21</nova:creationTime>
Nov 14 11:24:21 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:24:21 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:24:21 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:24:21 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:24:21 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:24:21 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:24:21 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:24:21 user nova-compute[75255]:       <nova:owner>
Nov 14 11:24:21 user nova-compute[75255]:         <nova:user uuid="7b4b049ae1654b4495e42b8ec2cb11f9">tempest-AttachVolumeShelveTestJSON-479009518-project-member</nova:user>
Nov 14 11:24:21 user nova-compute[75255]:         <nova:project uuid="539e7facdc2a4ce081fa5eff222d0193">tempest-AttachVolumeShelveTestJSON-479009518</nova:project>
Nov 14 11:24:21 user nova-compute[75255]:       </nova:owner>
Nov 14 11:24:21 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:24:21 user nova-compute[75255]:       <nova:ports>
Nov 14 11:24:21 user nova-compute[75255]:         <nova:port uuid="be93b8c3-8ade-4f96-b9b5-8da5cac2cd49">
Nov 14 11:24:21 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:24:21 user nova-compute[75255]:         </nova:port>
Nov 14 11:24:21 user nova-compute[75255]:       </nova:ports>
Nov 14 11:24:21 user nova-compute[75255]:     </nova:instance>
Nov 14 11:24:21 user nova-compute[75255]:   </metadata>
Nov 14 11:24:21 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:24:21 user nova-compute[75255]:     <system>
Nov 14 11:24:21 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:24:21 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:24:21 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:24:21 user nova-compute[75255]:       <entry name="serial">7976be6c-afb4-4ddf-ac33-ddbd8a23265e</entry>
Nov 14 11:24:21 user nova-compute[75255]:       <entry name="uuid">7976be6c-afb4-4ddf-ac33-ddbd8a23265e</entry>
Nov 14 11:24:21 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:24:21 user nova-compute[75255]:     </system>
Nov 14 11:24:21 user nova-compute[75255]:   </sysinfo>
Nov 14 11:24:21 user nova-compute[75255]:   <os>
Nov 14 11:24:21 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:24:21 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:24:21 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:24:21 user nova-compute[75255]:   </os>
Nov 14 11:24:21 user nova-compute[75255]:   <features>
Nov 14 11:24:21 user nova-compute[75255]:     <acpi/>
Nov 14 11:24:21 user nova-compute[75255]:     <apic/>
Nov 14 11:24:21 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:24:21 user nova-compute[75255]:   </features>
Nov 14 11:24:21 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:24:21 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:24:21 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:24:21 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:24:21 user nova-compute[75255]:   </clock>
Nov 14 11:24:21 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:24:21 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:24:21 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:24:21 user nova-compute[75255]:   </cpu>
Nov 14 11:24:21 user nova-compute[75255]:   <devices>
Nov 14 11:24:21 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:24:21 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:24:21 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk"/>
Nov 14 11:24:21 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:24:21 user nova-compute[75255]:     </disk>
Nov 14 11:24:21 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:24:21 user nova-compute[75255]:       <mac address="fa:16:3e:2f:00:7c"/>
Nov 14 11:24:21 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:21 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:24:21 user nova-compute[75255]:       <target dev="tapbe93b8c3-8a"/>
Nov 14 11:24:21 user nova-compute[75255]:     </interface>
Nov 14 11:24:21 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:24:21 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/console.log" append="off"/>
Nov 14 11:24:21 user nova-compute[75255]:     </serial>
Nov 14 11:24:21 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:24:21 user nova-compute[75255]:     <video>
Nov 14 11:24:21 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:21 user nova-compute[75255]:     </video>
Nov 14 11:24:21 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:24:21 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:24:21 user nova-compute[75255]:     </rng>
Nov 14 11:24:21 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:24:21 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:24:21 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:24:21 user nova-compute[75255]:     </memballoon>
Nov 14 11:24:21 user nova-compute[75255]:   </devices>
Nov 14 11:24:21 user nova-compute[75255]: </domain>
Nov 14 11:24:21 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984960086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984960086',id=34,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkig5pg750P4RIFQnqNLC/Mj9a0A19astPZfi6byTXL6e6EfI3unEeWVANHnucwQKGZRidB6ciCLZOg4qqyrZIl6EnDHhsUbPcN08n0FQuCBZRCo7ozmRH+1BoerVVygA==',key_name='tempest-keypair-1100144298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-90adzxhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=7976be6c-afb4-4ddf-ac33-ddbd8a23265e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG os_vif [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46e8c5ec-e649-5e26-903e-fdaab944acc8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe93b8c3-8a, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe93b8c3-8a, col_values=(('qos', UUID('57e10168-e5bb-4eba-a18f-004df566a267')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe93b8c3-8a, col_values=(('external_ids', {'iface-id': 'be93b8c3-8ade-4f96-b9b5-8da5cac2cd49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:00:7c', 'vm-uuid': '7976be6c-afb4-4ddf-ac33-ddbd8a23265e'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:21 user nova-compute[75255]: INFO os_vif [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a')
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:24:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No VIF found with MAC fa:16:3e:2f:00:7c, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:24:22 user nova-compute[75255]: INFO nova.compute.claims [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Claim successful on node user
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.network.neutron [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updated VIF entry in instance network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.network.neutron [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-141896fd-c92f-48f6-81f9-47cf052d5ab8 req-4fbea4f4-6983-43db-a7b8-404416af3204 service nova] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:24:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.policy [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d356b8218514e458c45ec3066bad892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddf20982f454dd4a1c831e064b41ec6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:24:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Creating image(s)
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "/opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "/opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.225s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.254s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk 1073741824" returned: 0 in 0.099s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Successfully created port: d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.206s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-fc59e8b9-e2e7-458d-8b84-c6a766746e34 req-2f8b76b6-c5c0-4bbd-ad1e-689bec099eda service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fc59e8b9-e2e7-458d-8b84-c6a766746e34 req-2f8b76b6-c5c0-4bbd-ad1e-689bec099eda service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fc59e8b9-e2e7-458d-8b84-c6a766746e34 req-2f8b76b6-c5c0-4bbd-ad1e-689bec099eda service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fc59e8b9-e2e7-458d-8b84-c6a766746e34 req-2f8b76b6-c5c0-4bbd-ad1e-689bec099eda service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-fc59e8b9-e2e7-458d-8b84-c6a766746e34 req-2f8b76b6-c5c0-4bbd-ad1e-689bec099eda service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:23 user nova-compute[75255]: WARNING nova.compute.manager [req-fc59e8b9-e2e7-458d-8b84-c6a766746e34 req-2f8b76b6-c5c0-4bbd-ad1e-689bec099eda service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received unexpected event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with vm_state building and task_state spawning.
Nov 14 11:24:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Cannot resize image /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Ensure instance console log exists: /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Successfully updated port: d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquired lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-changed-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Refreshing instance network info cache due to event network-changed-d8c74dba-f494-4742-8a24-cc6f01cae599. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] Acquiring lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Updating instance_info_cache with network_info: [{"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Releasing lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Instance network_info: |[{"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] Acquired lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.neutron [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Refreshing network info cache for port d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Start _get_guest_xml network_info=[{"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:24:24 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:24 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-577568692',display_name='tempest-VolumesSnapshotTestJSON-instance-577568692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-577568692',id=35,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVAymGUGdQ0bqruXVB0G41a1e3ucM3H6Y5QbjtbFP6aREVqE0dqi2Kb09v0QpKGH7xr89UEYYJMqzXFWETTQoiu5/gZ+tz70gVH4NzqH/h5H6CeEoSYlf9SN4pts17OAg==',key_name='tempest-keypair-612809553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ddf20982f454dd4a1c831e064b41ec6',ramdisk_id='',reservation_id='r-ybale95o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-610019682',owner_user_name='tempest-VolumesSnapshotTestJSON-610019682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d356b8218514e458c45ec3066bad892',uuid=aa807cc9-5175-4b36-8210-7cef688b71c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converting VIF {"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:22:f6,bridge_name='br-int',has_traffic_filtering=True,id=d8c74dba-f494-4742-8a24-cc6f01cae599,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c74dba-f4') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'pci_devices' on Instance uuid aa807cc9-5175-4b36-8210-7cef688b71c1 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:24:24 user nova-compute[75255]:   <uuid>aa807cc9-5175-4b36-8210-7cef688b71c1</uuid>
Nov 14 11:24:24 user nova-compute[75255]:   <name>instance-00000023</name>
Nov 14 11:24:24 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:24:24 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:24:24 user nova-compute[75255]:   <metadata>
Nov 14 11:24:24 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:24:24 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:24:24 user nova-compute[75255]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-577568692</nova:name>
Nov 14 11:24:24 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:24:24</nova:creationTime>
Nov 14 11:24:24 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:24:24 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:24:24 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:24:24 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:24:24 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:24:24 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:24:24 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:24:24 user nova-compute[75255]:       <nova:owner>
Nov 14 11:24:24 user nova-compute[75255]:         <nova:user uuid="5d356b8218514e458c45ec3066bad892">tempest-VolumesSnapshotTestJSON-610019682-project-member</nova:user>
Nov 14 11:24:24 user nova-compute[75255]:         <nova:project uuid="3ddf20982f454dd4a1c831e064b41ec6">tempest-VolumesSnapshotTestJSON-610019682</nova:project>
Nov 14 11:24:24 user nova-compute[75255]:       </nova:owner>
Nov 14 11:24:24 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:24:24 user nova-compute[75255]:       <nova:ports>
Nov 14 11:24:24 user nova-compute[75255]:         <nova:port uuid="d8c74dba-f494-4742-8a24-cc6f01cae599">
Nov 14 11:24:24 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 11:24:24 user nova-compute[75255]:         </nova:port>
Nov 14 11:24:24 user nova-compute[75255]:       </nova:ports>
Nov 14 11:24:24 user nova-compute[75255]:     </nova:instance>
Nov 14 11:24:24 user nova-compute[75255]:   </metadata>
Nov 14 11:24:24 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:24:24 user nova-compute[75255]:     <system>
Nov 14 11:24:24 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:24:24 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:24:24 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:24:24 user nova-compute[75255]:       <entry name="serial">aa807cc9-5175-4b36-8210-7cef688b71c1</entry>
Nov 14 11:24:24 user nova-compute[75255]:       <entry name="uuid">aa807cc9-5175-4b36-8210-7cef688b71c1</entry>
Nov 14 11:24:24 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:24:24 user nova-compute[75255]:     </system>
Nov 14 11:24:24 user nova-compute[75255]:   </sysinfo>
Nov 14 11:24:24 user nova-compute[75255]:   <os>
Nov 14 11:24:24 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:24:24 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:24:24 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:24:24 user nova-compute[75255]:   </os>
Nov 14 11:24:24 user nova-compute[75255]:   <features>
Nov 14 11:24:24 user nova-compute[75255]:     <acpi/>
Nov 14 11:24:24 user nova-compute[75255]:     <apic/>
Nov 14 11:24:24 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:24:24 user nova-compute[75255]:   </features>
Nov 14 11:24:24 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:24:24 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:24:24 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:24:24 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:24:24 user nova-compute[75255]:   </clock>
Nov 14 11:24:24 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:24:24 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:24:24 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:24:24 user nova-compute[75255]:   </cpu>
Nov 14 11:24:24 user nova-compute[75255]:   <devices>
Nov 14 11:24:24 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:24:24 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:24:24 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk"/>
Nov 14 11:24:24 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:24:24 user nova-compute[75255]:     </disk>
Nov 14 11:24:24 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:24:24 user nova-compute[75255]:       <mac address="fa:16:3e:5e:22:f6"/>
Nov 14 11:24:24 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:24 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:24:24 user nova-compute[75255]:       <target dev="tapd8c74dba-f4"/>
Nov 14 11:24:24 user nova-compute[75255]:     </interface>
Nov 14 11:24:24 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:24:24 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/console.log" append="off"/>
Nov 14 11:24:24 user nova-compute[75255]:     </serial>
Nov 14 11:24:24 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:24:24 user nova-compute[75255]:     <video>
Nov 14 11:24:24 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:24 user nova-compute[75255]:     </video>
Nov 14 11:24:24 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:24:24 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:24:24 user nova-compute[75255]:     </rng>
Nov 14 11:24:24 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:24:24 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:24:24 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:24:24 user nova-compute[75255]:     </memballoon>
Nov 14 11:24:24 user nova-compute[75255]:   </devices>
Nov 14 11:24:24 user nova-compute[75255]: </domain>
Nov 14 11:24:24 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-577568692',display_name='tempest-VolumesSnapshotTestJSON-instance-577568692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-577568692',id=35,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVAymGUGdQ0bqruXVB0G41a1e3ucM3H6Y5QbjtbFP6aREVqE0dqi2Kb09v0QpKGH7xr89UEYYJMqzXFWETTQoiu5/gZ+tz70gVH4NzqH/h5H6CeEoSYlf9SN4pts17OAg==',key_name='tempest-keypair-612809553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ddf20982f454dd4a1c831e064b41ec6',ramdisk_id='',reservation_id='r-ybale95o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-610019682',owner_user_name='tempest-VolumesSnapshotTestJSON-610019682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d356b8218514e458c45ec3066bad892',uuid=aa807cc9-5175-4b36-8210-7cef688b71c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converting VIF {"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:22:f6,bridge_name='br-int',has_traffic_filtering=True,id=d8c74dba-f494-4742-8a24-cc6f01cae599,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c74dba-f4') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG os_vif [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:22:f6,bridge_name='br-int',has_traffic_filtering=True,id=d8c74dba-f494-4742-8a24-cc6f01cae599,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c74dba-f4') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7942135b-09e0-5e38-8bb7-e55b89230ae3', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c74dba-f4, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8c74dba-f4, col_values=(('qos', UUID('bc7f9935-ad18-43ec-b754-4e5bbdbbfb0e')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8c74dba-f4, col_values=(('external_ids', {'iface-id': 'd8c74dba-f494-4742-8a24-cc6f01cae599', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:22:f6', 'vm-uuid': 'aa807cc9-5175-4b36-8210-7cef688b71c1'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:24 user nova-compute[75255]: INFO os_vif [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:22:f6,bridge_name='br-int',has_traffic_filtering=True,id=d8c74dba-f494-4742-8a24-cc6f01cae599,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c74dba-f4')
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No VIF found with MAC fa:16:3e:5e:22:f6, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Updated VIF entry in instance network info cache for port d8c74dba-f494-4742-8a24-cc6f01cae599. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Updating instance_info_cache with network_info: [{"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-921ee951-d734-4975-9f1c-1abaf588a5d0 req-93ecbea2-ece1-489d-a3b6-c4b2b32aec4b service nova] Releasing lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:24:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance spawned successfully.
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:25 user nova-compute[75255]: INFO nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:24:25 user nova-compute[75255]: INFO nova.compute.manager [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Took 6.69 seconds to build instance.
Nov 14 11:24:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-08a12931-5e76-4c02-a604-929cd7a4e2fa tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.783s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-c75b6737-c9ac-4083-a048-56728f24a7b3 req-d739b758-a992-43f6-9613-46f91e882ee3 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c75b6737-c9ac-4083-a048-56728f24a7b3 req-d739b758-a992-43f6-9613-46f91e882ee3 service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c75b6737-c9ac-4083-a048-56728f24a7b3 req-d739b758-a992-43f6-9613-46f91e882ee3 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c75b6737-c9ac-4083-a048-56728f24a7b3 req-d739b758-a992-43f6-9613-46f91e882ee3 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-c75b6737-c9ac-4083-a048-56728f24a7b3 req-d739b758-a992-43f6-9613-46f91e882ee3 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:25 user nova-compute[75255]: WARNING nova.compute.manager [req-c75b6737-c9ac-4083-a048-56728f24a7b3 req-d739b758-a992-43f6-9613-46f91e882ee3 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received unexpected event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with vm_state active and task_state None.
Nov 14 11:24:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-0d4f8589-21db-4d04-b642-417728986b1e req-f6b8f121-3716-41be-a696-2ef85941e21a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0d4f8589-21db-4d04-b642-417728986b1e req-f6b8f121-3716-41be-a696-2ef85941e21a service nova] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0d4f8589-21db-4d04-b642-417728986b1e req-f6b8f121-3716-41be-a696-2ef85941e21a service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0d4f8589-21db-4d04-b642-417728986b1e req-f6b8f121-3716-41be-a696-2ef85941e21a service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-0d4f8589-21db-4d04-b642-417728986b1e req-f6b8f121-3716-41be-a696-2ef85941e21a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] No waiting events found dispatching network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:26 user nova-compute[75255]: WARNING nova.compute.manager [req-0d4f8589-21db-4d04-b642-417728986b1e req-f6b8f121-3716-41be-a696-2ef85941e21a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received unexpected event network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 for instance with vm_state building and task_state spawning.
Nov 14 11:24:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "a479fa6c-e55a-4751-b98f-6b4b5458b681" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:24:27 user nova-compute[75255]: INFO nova.compute.claims [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Claim successful on node user
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:24:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:24:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Creating image(s)
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "/opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "/opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "/opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:27 user nova-compute[75255]: DEBUG nova.policy [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69bb454dba1740fc84bdc054b8378f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d3a0e09f084b8aabcb048bb5e9fb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk 1073741824" returned: 0 in 0.049s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Successfully created port: f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:24:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Instance spawned successfully.
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Cannot resize image /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Ensure instance console log exists: /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-fcbf3cbd-bfb6-4077-a349-fe49d1d8c6ea req-e4c6513d-c15e-4cc9-ab6a-f5cec01cc65c service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fcbf3cbd-bfb6-4077-a349-fe49d1d8c6ea req-e4c6513d-c15e-4cc9-ab6a-f5cec01cc65c service nova] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fcbf3cbd-bfb6-4077-a349-fe49d1d8c6ea req-e4c6513d-c15e-4cc9-ab6a-f5cec01cc65c service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fcbf3cbd-bfb6-4077-a349-fe49d1d8c6ea req-e4c6513d-c15e-4cc9-ab6a-f5cec01cc65c service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-fcbf3cbd-bfb6-4077-a349-fe49d1d8c6ea req-e4c6513d-c15e-4cc9-ab6a-f5cec01cc65c service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] No waiting events found dispatching network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:28 user nova-compute[75255]: WARNING nova.compute.manager [req-fcbf3cbd-bfb6-4077-a349-fe49d1d8c6ea req-e4c6513d-c15e-4cc9-ab6a-f5cec01cc65c service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received unexpected event network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 for instance with vm_state building and task_state spawning.
Nov 14 11:24:28 user nova-compute[75255]: INFO nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 14 11:24:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:24:28 user nova-compute[75255]: INFO nova.compute.manager [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Took 6.67 seconds to build instance.
Nov 14 11:24:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9e93e6b-3d8d-49c0-8f3f-bff9be9154d6 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.774s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Successfully updated port: f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "refresh_cache-a479fa6c-e55a-4751-b98f-6b4b5458b681" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquired lock "refresh_cache-a479fa6c-e55a-4751-b98f-6b4b5458b681" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received event network-changed-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Refreshing instance network info cache due to event network-changed-f744e2d5-101b-4f1c-af9b-722a24611680. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] Acquiring lock "refresh_cache-a479fa6c-e55a-4751-b98f-6b4b5458b681" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Updating instance_info_cache with network_info: [{"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Releasing lock "refresh_cache-a479fa6c-e55a-4751-b98f-6b4b5458b681" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Instance network_info: |[{"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] Acquired lock "refresh_cache-a479fa6c-e55a-4751-b98f-6b4b5458b681" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.neutron [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Refreshing network info cache for port f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Start _get_guest_xml network_info=[{"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:24:29 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:29 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1438842001',display_name='tempest-VolumesNegativeTest-instance-1438842001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1438842001',id=36,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03d3a0e09f084b8aabcb048bb5e9fb84',ramdisk_id='',reservation_id='r-vnlf9uh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-553619403',owner_user_name='tempest-VolumesNegativeTest-553619403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:28Z,user_data=None,user_id='69bb454dba1740fc84bdc054b8378f7c',uuid=a479fa6c-e55a-4751-b98f-6b4b5458b681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Converting VIF {"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:61:57,bridge_name='br-int',has_traffic_filtering=True,id=f744e2d5-101b-4f1c-af9b-722a24611680,network=Network(ef384ab3-91fb-4d75-a862-e303905326ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf744e2d5-10') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lazy-loading 'pci_devices' on Instance uuid a479fa6c-e55a-4751-b98f-6b4b5458b681 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:24:29 user nova-compute[75255]:   <uuid>a479fa6c-e55a-4751-b98f-6b4b5458b681</uuid>
Nov 14 11:24:29 user nova-compute[75255]:   <name>instance-00000024</name>
Nov 14 11:24:29 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:24:29 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:24:29 user nova-compute[75255]:   <metadata>
Nov 14 11:24:29 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:24:29 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:24:29 user nova-compute[75255]:       <nova:name>tempest-VolumesNegativeTest-instance-1438842001</nova:name>
Nov 14 11:24:29 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:24:29</nova:creationTime>
Nov 14 11:24:29 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:24:29 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:24:29 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:24:29 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:24:29 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:24:29 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:24:29 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:24:29 user nova-compute[75255]:       <nova:owner>
Nov 14 11:24:29 user nova-compute[75255]:         <nova:user uuid="69bb454dba1740fc84bdc054b8378f7c">tempest-VolumesNegativeTest-553619403-project-member</nova:user>
Nov 14 11:24:29 user nova-compute[75255]:         <nova:project uuid="03d3a0e09f084b8aabcb048bb5e9fb84">tempest-VolumesNegativeTest-553619403</nova:project>
Nov 14 11:24:29 user nova-compute[75255]:       </nova:owner>
Nov 14 11:24:29 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:24:29 user nova-compute[75255]:       <nova:ports>
Nov 14 11:24:29 user nova-compute[75255]:         <nova:port uuid="f744e2d5-101b-4f1c-af9b-722a24611680">
Nov 14 11:24:29 user nova-compute[75255]:           <nova:ip type="fixed" address="192.168.233.182" ipVersion="4"/>
Nov 14 11:24:29 user nova-compute[75255]:         </nova:port>
Nov 14 11:24:29 user nova-compute[75255]:       </nova:ports>
Nov 14 11:24:29 user nova-compute[75255]:     </nova:instance>
Nov 14 11:24:29 user nova-compute[75255]:   </metadata>
Nov 14 11:24:29 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:24:29 user nova-compute[75255]:     <system>
Nov 14 11:24:29 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:24:29 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:24:29 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:24:29 user nova-compute[75255]:       <entry name="serial">a479fa6c-e55a-4751-b98f-6b4b5458b681</entry>
Nov 14 11:24:29 user nova-compute[75255]:       <entry name="uuid">a479fa6c-e55a-4751-b98f-6b4b5458b681</entry>
Nov 14 11:24:29 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:24:29 user nova-compute[75255]:     </system>
Nov 14 11:24:29 user nova-compute[75255]:   </sysinfo>
Nov 14 11:24:29 user nova-compute[75255]:   <os>
Nov 14 11:24:29 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:24:29 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:24:29 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:24:29 user nova-compute[75255]:   </os>
Nov 14 11:24:29 user nova-compute[75255]:   <features>
Nov 14 11:24:29 user nova-compute[75255]:     <acpi/>
Nov 14 11:24:29 user nova-compute[75255]:     <apic/>
Nov 14 11:24:29 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:24:29 user nova-compute[75255]:   </features>
Nov 14 11:24:29 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:24:29 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:24:29 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:24:29 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:24:29 user nova-compute[75255]:   </clock>
Nov 14 11:24:29 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:24:29 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:24:29 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:24:29 user nova-compute[75255]:   </cpu>
Nov 14 11:24:29 user nova-compute[75255]:   <devices>
Nov 14 11:24:29 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:24:29 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:24:29 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk"/>
Nov 14 11:24:29 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:24:29 user nova-compute[75255]:     </disk>
Nov 14 11:24:29 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:24:29 user nova-compute[75255]:       <mac address="fa:16:3e:0e:61:57"/>
Nov 14 11:24:29 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:29 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:24:29 user nova-compute[75255]:       <target dev="tapf744e2d5-10"/>
Nov 14 11:24:29 user nova-compute[75255]:     </interface>
Nov 14 11:24:29 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:24:29 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/console.log" append="off"/>
Nov 14 11:24:29 user nova-compute[75255]:     </serial>
Nov 14 11:24:29 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:24:29 user nova-compute[75255]:     <video>
Nov 14 11:24:29 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:29 user nova-compute[75255]:     </video>
Nov 14 11:24:29 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:24:29 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:24:29 user nova-compute[75255]:     </rng>
Nov 14 11:24:29 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:24:29 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:24:29 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:24:29 user nova-compute[75255]:     </memballoon>
Nov 14 11:24:29 user nova-compute[75255]:   </devices>
Nov 14 11:24:29 user nova-compute[75255]: </domain>
Nov 14 11:24:29 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1438842001',display_name='tempest-VolumesNegativeTest-instance-1438842001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1438842001',id=36,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03d3a0e09f084b8aabcb048bb5e9fb84',ramdisk_id='',reservation_id='r-vnlf9uh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-553619403',owner_user_name='tempest-VolumesNegativeTest-553619403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:28Z,user_data=None,user_id='69bb454dba1740fc84bdc054b8378f7c',uuid=a479fa6c-e55a-4751-b98f-6b4b5458b681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Converting VIF {"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:61:57,bridge_name='br-int',has_traffic_filtering=True,id=f744e2d5-101b-4f1c-af9b-722a24611680,network=Network(ef384ab3-91fb-4d75-a862-e303905326ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf744e2d5-10') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG os_vif [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:61:57,bridge_name='br-int',has_traffic_filtering=True,id=f744e2d5-101b-4f1c-af9b-722a24611680,network=Network(ef384ab3-91fb-4d75-a862-e303905326ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf744e2d5-10') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d64e74b-1526-535b-9c3d-cd7781ce560a', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf744e2d5-10, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf744e2d5-10, col_values=(('qos', UUID('ab5da0fb-5ce4-41d8-b640-57cc9128fc55')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf744e2d5-10, col_values=(('external_ids', {'iface-id': 'f744e2d5-101b-4f1c-af9b-722a24611680', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:61:57', 'vm-uuid': 'a479fa6c-e55a-4751-b98f-6b4b5458b681'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:29 user nova-compute[75255]: INFO os_vif [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:61:57,bridge_name='br-int',has_traffic_filtering=True,id=f744e2d5-101b-4f1c-af9b-722a24611680,network=Network(ef384ab3-91fb-4d75-a862-e303905326ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf744e2d5-10')
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:24:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] No VIF found with MAC fa:16:3e:0e:61:57, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:24:30 user nova-compute[75255]: DEBUG nova.network.neutron [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Updated VIF entry in instance network info cache for port f744e2d5-101b-4f1c-af9b-722a24611680. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:24:30 user nova-compute[75255]: DEBUG nova.network.neutron [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Updating instance_info_cache with network_info: [{"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9551b135-b527-4751-9deb-d206292d51af req-ecef7e26-f34c-4e1d-a0f7-24ca7e936653 service nova] Releasing lock "refresh_cache-a479fa6c-e55a-4751-b98f-6b4b5458b681" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-d350dc92-7198-4129-afc9-152f616ada44 req-d7dbf17a-0956-44cb-bc19-742766d2e298 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received event network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d350dc92-7198-4129-afc9-152f616ada44 req-d7dbf17a-0956-44cb-bc19-742766d2e298 service nova] Acquiring lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d350dc92-7198-4129-afc9-152f616ada44 req-d7dbf17a-0956-44cb-bc19-742766d2e298 service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d350dc92-7198-4129-afc9-152f616ada44 req-d7dbf17a-0956-44cb-bc19-742766d2e298 service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-d350dc92-7198-4129-afc9-152f616ada44 req-d7dbf17a-0956-44cb-bc19-742766d2e298 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] No waiting events found dispatching network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:31 user nova-compute[75255]: WARNING nova.compute.manager [req-d350dc92-7198-4129-afc9-152f616ada44 req-d7dbf17a-0956-44cb-bc19-742766d2e298 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received unexpected event network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 for instance with vm_state building and task_state spawning.
Nov 14 11:24:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:24:33 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Instance spawned successfully.
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-c4a62519-1d58-44d0-bd36-c00c00d7657e req-166a367f-48cc-42d7-9a5a-167195222e14 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received event network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c4a62519-1d58-44d0-bd36-c00c00d7657e req-166a367f-48cc-42d7-9a5a-167195222e14 service nova] Acquiring lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c4a62519-1d58-44d0-bd36-c00c00d7657e req-166a367f-48cc-42d7-9a5a-167195222e14 service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c4a62519-1d58-44d0-bd36-c00c00d7657e req-166a367f-48cc-42d7-9a5a-167195222e14 service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-c4a62519-1d58-44d0-bd36-c00c00d7657e req-166a367f-48cc-42d7-9a5a-167195222e14 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] No waiting events found dispatching network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:33 user nova-compute[75255]: WARNING nova.compute.manager [req-c4a62519-1d58-44d0-bd36-c00c00d7657e req-166a367f-48cc-42d7-9a5a-167195222e14 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received unexpected event network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 for instance with vm_state building and task_state spawning.
Nov 14 11:24:33 user nova-compute[75255]: INFO nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 14 11:24:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:24:33 user nova-compute[75255]: INFO nova.compute.manager [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Took 6.67 seconds to build instance.
Nov 14 11:24:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e5b7e88f-e6dd-48be-8409-db1959419cb6 tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.764s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:24:42 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:42 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7878MB free_disk=25.158363342285156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ae76487b-9360-43d4-b081-68186acc2565 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 68bca729-db5f-4edd-9549-979c5b00e49b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance aa807cc9-5175-4b36-8210-7cef688b71c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance a479fa6c-e55a-4751-b98f-6b4b5458b681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:24:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:24:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 24e046fb-04f4-49f8-bfa8-951334e25e5f {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updating instance_info_cache with network_info: [{"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-24e046fb-04f4-49f8-bfa8-951334e25e5f" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:24:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-changed-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Refreshing instance network info cache due to event network-changed-7492baa9-355a-4952-b448-c87d075c46d5. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] Acquiring lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] Acquired lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Refreshing network info cache for port 7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updated VIF entry in instance network info cache for port 7492baa9-355a-4952-b448-c87d075c46d5. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-38051275-e498-4d3b-b1f6-491ba187332c req-3fe0d5b0-7be5-48a0-a93c-fb7aee12fd1d service nova] Releasing lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Stashing vm_state: active {{(pid=75255) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:24:52 user nova-compute[75255]: INFO nova.compute.claims [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Claim successful on node user
Nov 14 11:24:52 user nova-compute[75255]: INFO nova.compute.resource_tracker [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating resource usage from migration 6aa6d7a1-5ad7-449f-a4de-6fbbe96d78a1
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.compute.manager [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-changed-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.compute.manager [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Refreshing instance network info cache due to event network-changed-b1108729-e7e5-4de3-99ba-daf01a2ca472. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] Acquiring lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] Acquired lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.network.neutron [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Refreshing network info cache for port b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.396s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:52 user nova-compute[75255]: INFO nova.compute.manager [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Migrating
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.network.neutron [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updated VIF entry in instance network info cache for port b1108729-e7e5-4de3-99ba-daf01a2ca472. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.network.neutron [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3b42599e-c3ba-41bc-b9b1-14ae0dcd71d5 req-49c796a3-0ad7-4137-a7d4-89cdeb6e8988 service nova] Releasing lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquired lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:52 user nova-compute[75255]: DEBUG nova.network.neutron [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG nova.network.neutron [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Releasing lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Starting migrate_disk_and_power_off {{(pid=75255) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-36746cda-c18e-49e2-9e09-3a73a013bcc7 req-93fce888-d605-4830-bcfb-506328d2842a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-unplugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36746cda-c18e-49e2-9e09-3a73a013bcc7 req-93fce888-d605-4830-bcfb-506328d2842a service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36746cda-c18e-49e2-9e09-3a73a013bcc7 req-93fce888-d605-4830-bcfb-506328d2842a service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36746cda-c18e-49e2-9e09-3a73a013bcc7 req-93fce888-d605-4830-bcfb-506328d2842a service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-36746cda-c18e-49e2-9e09-3a73a013bcc7 req-93fce888-d605-4830-bcfb-506328d2842a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-unplugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:53 user nova-compute[75255]: WARNING nova.compute.manager [req-36746cda-c18e-49e2-9e09-3a73a013bcc7 req-93fce888-d605-4830-bcfb-506328d2842a service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received unexpected event network-vif-unplugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with vm_state active and task_state resize_migrating.
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: INFO nova.compute.manager [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Rescuing
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:24:54 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance destroyed successfully.
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112388371',display_name='tempest-ServerActionsTestOtherA-server-2112388371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112388371',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:23:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-2efmp59p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=eaf8bf74-7ef8-4eca-8098-0a675ca188cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1050170865-network", "vif_mac": "fa:16:3e:2c:a0:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1050170865-network", "vif_mac": "fa:16:3e:2c:a0:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_vif [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1108729-e7, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df640624-cf2e-4252-a72c-72aa20513818) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: INFO os_vif [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7')
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:24:54 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3692fae-34eb-49d6-b9b0-3c4c71ffdf15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:24:54 user nova-compute[75255]: No targets found.
Nov 14 11:24:54 user nova-compute[75255]: iSNS:
Nov 14 11:24:54 user nova-compute[75255]: No targets found.
Nov 14 11:24:54 user nova-compute[75255]: STATIC:
Nov 14 11:24:54 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:24:54 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:24:54 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:24:54 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b
Nov 14 11:24:54 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:24:54 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:24:54 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:24:54 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:24:54 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:24:54 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:24:54 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:24:54 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:24:54 user nova-compute[75255]: FIRMWARE:
Nov 14 11:24:54 user nova-compute[75255]: No targets found.
Nov 14 11:24:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:24:54 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:24:54 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe4661-6b89-4d58-8386-c78370a60001]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68d2568-ed38-4e3d-b5bb-daeb9e563a7f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:24:54 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:24:54 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:24:54 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:24:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:24:54 user nova-compute[75255]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:24:54 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:24:54 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:24:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086ddea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Updating instance_info_cache with network_info: [{"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4000ef-d364-43eb-8481-5d6d4a35203f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cc9214-f676-4eec-9e1d-2306fa903802]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc1435e-b38a-4b04-b66f-4b5db4d67391]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[856f6077-f4d0-44a9-a06c-eb86efee4894]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8ff4fdbb', '/dev/disk/by-id/scsi-1SCST_BIO8ff4fdbb-6117e567c4169bd4', '/dev/disk/by-id/scsi-23631313765353637') {{(pid=86497) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cc48c6-59b9-4f26-8a56-ad7e87003abe]: (4, None) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1289481-997f-4f7c-88dd-1acc424ffd88]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[422827e6-5f95-4b43-9d34-19981cae8589]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]
Nov 14 11:24:54 user nova-compute[75255]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.
Nov 14 11:24:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe912719-efd1-4b16-8e49-f4399b2cd0eb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== disconnect_volume: return (365ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:24:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance destroyed successfully.
Nov 14 11:24:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Attempting a stable device rescue
Nov 14 11:24:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75255) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:24:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Creating image(s)
Nov 14 11:24:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "/opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "0b96c7442cc02923f941baadb18a143bbd871e4b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "0b96c7442cc02923f941baadb18a143bbd871e4b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing instance network info cache due to event network-changed-7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] Acquiring lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] Acquired lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Refreshing network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:56 user nova-compute[75255]: WARNING nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received unexpected event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with vm_state active and task_state resize_migrating.
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:56 user nova-compute[75255]: WARNING nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state active and task_state rescuing.
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:56 user nova-compute[75255]: WARNING nova.compute.manager [req-fafb1660-ccce-4b6b-9bdd-b200a600bb14 req-05d1b9fb-2452-4fc7-9488-6589fccb16e0 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state active and task_state rescuing.
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:56 user nova-compute[75255]: INFO nova.compute.manager [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Terminating instance
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Port b1108729-e7e5-4de3-99ba-daf01a2ca472 binding to destination host user is already ACTIVE {{(pid=75255) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.part --force-share --output=json" returned: 0 in 0.214s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.virt.images [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] 185f743a-0808-4140-9c98-4056831852e8 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:24:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.part /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquired lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.network.neutron [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.part /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.converted" returned: 0 in 0.489s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updated VIF entry in instance network info cache for port 7a833ede-1eff-4e41-89ff-72ecc27b25bb. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [{"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2bc84622-7677-4786-82db-6ff19f98e239 req-e74d7047-3722-4f6b-9171-1c7def675f80 service nova] Releasing lock "refresh_cache-68bca729-db5f-4edd-9549-979c5b00e49b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "0b96c7442cc02923f941baadb18a143bbd871e4b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.081s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "0b96c7442cc02923f941baadb18a143bbd871e4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "0b96c7442cc02923f941baadb18a143bbd871e4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Instance destroyed successfully.
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lazy-loading 'resources' on Instance uuid 68bca729-db5f-4edd-9549-979c5b00e49b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-805539077',display_name='tempest-TestShelveInstance-server-805539077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-805539077',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTHn8Uben8kK2HaTK5LXH7Z3lHOnonZd+cDcfzzZ1UJxtCZoI3X6OBueXUBHhGY1k7PvPP/6+WSVMWzc5YYhg+EbZ0iUNr7HCK+glYRgYaTtTB0GabI5QPZwmVJZX9EDw==',key_name='tempest-TestShelveInstance-287110248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b5b339310242ea8837a4a3ffee6532',ramdisk_id='',reservation_id='r-g6gjeea3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1188210100',owner_user_name='tempest-TestShelveInstance-1188210100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:23:18Z,user_data=None,user_id='0a68d5e2b8b64a289abf08bba42e1033',uuid=68bca729-db5f-4edd-9549-979c5b00e49b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converting VIF {"id": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "address": "fa:16:3e:a4:eb:ca", "network": {"id": "85ad990c-26d2-45f2-a2dc-4f55a8d27c93", "bridge": "br-int", "label": "tempest-TestShelveInstance-662245856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b5b339310242ea8837a4a3ffee6532", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a833ede-1e", "ovs_interfaceid": "7a833ede-1eff-4e41-89ff-72ecc27b25bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_vif [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a833ede-1e, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3d4102b-a5ee-4f88-b48e-d69d3051ce65) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:57 user nova-compute[75255]: INFO os_vif [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:eb:ca,bridge_name='br-int',has_traffic_filtering=True,id=7a833ede-1eff-4e41-89ff-72ecc27b25bb,network=Network(85ad990c-26d2-45f2-a2dc-4f55a8d27c93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a833ede-1e')
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWxZBNVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:24:57 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eb1ef8-b35c-432b-93c8-7a521b9b1776]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:24:57 user nova-compute[75255]: No targets found.
Nov 14 11:24:57 user nova-compute[75255]: iSNS:
Nov 14 11:24:57 user nova-compute[75255]: No targets found.
Nov 14 11:24:57 user nova-compute[75255]: STATIC:
Nov 14 11:24:57 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b
Nov 14 11:24:57 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:24:57 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:24:57 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:24:57 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:24:57 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:24:57 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:24:57 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:24:57 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:24:57 user nova-compute[75255]: FIRMWARE:
Nov 14 11:24:57 user nova-compute[75255]: No targets found.
Nov 14 11:24:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:24:57 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:24:57 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e1e817-008b-4693-8de9-b3277baea9c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b,backing_fmt=raw /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.network.neutron [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffa6cde-4adb-4009-8947-fa6ce1727a6c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:24:57 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:24:57 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:24:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:24:57 user nova-compute[75255]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b (non-flash)
Nov 14 11:24:57 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:24:57 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086b9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b'): ({'sde'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Removing single pathed devices sde {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b,backing_fmt=raw /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue" returned: 0 in 0.060s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "0b96c7442cc02923f941baadb18a143bbd871e4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'migration_context' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Releasing lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.objects.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<ae76487b-9360-43d4-b081-68186acc2565> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Start _get_guest_xml network_info=[{"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "vif_mac": "fa:16:3e:e4:2e:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '185f743a-0808-4140-9c98-4056831852e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'a6254d36-7883-45bf-9d1a-87893773f47d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPvybpSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ae76487b-9360-43d4-b081-68186acc2565', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'serial': 'ac19eea3-84bb-4271-bec4-e8d4b409ffd1'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'resources' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c497409-a415-4716-9b14-e87563e5a957]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: True\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.objects.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<ae76487b-9360-43d4-b081-68186acc2565> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:24:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'numa_topology' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.objects.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<ae76487b-9360-43d4-b081-68186acc2565> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cacc72d-fd24-430f-9a0a-6bf45e06fa7b]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Flushing IO for device /dev/sde {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:58 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc4af1-f563-4ca9-ab7b-6d52ce38e63b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-unplugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-unplugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-unplugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] Acquiring lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] Lock "68bca729-db5f-4edd-9549-979c5b00e49b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] No waiting events found dispatching network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:24:58 user nova-compute[75255]: WARNING nova.compute.manager [req-1ea35ef1-25b9-49e0-87af-b0dd78b6d4bb req-054d8b6d-d4ad-4d97-afde-c4d8bca05e0e service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received unexpected event network-vif-plugged-7a833ede-1eff-4e41-89ff-72ecc27b25bb for instance with vm_state active and task_state deleting.
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.objects.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<ae76487b-9360-43d4-b081-68186acc2565> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPvybpSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:24:58 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bbd1b4-c61e-4966-9e34-3de226dc71d7]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6e036a-5000-4871-9eea-aa9bfb677818]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6afdb9-8de0-482d-a164-671c3cf224a5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762d79e-9158-49fa-9572-ea0ea89f584a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac18258-3294-4f0f-b3e9-e563b7241771]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98c226e-a7cb-41bb-b8cd-ba40137bc123]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1819335d-8364-41db-b50a-52bb6c7f82ea]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260]
Nov 14 11:24:58 user nova-compute[75255]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b, portal: 172.16.0.220,3260] successful.
Nov 14 11:24:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:24:58 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02ef6a-6219-4cb0-ac13-c70be47f8923]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fbc53d-534d-4d32-8319-6cc35b8cf74b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[be167064-9a0a-4223-94f1-0ee8c8fca89f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] <== disconnect_volume: return (455ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:24:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Deleting instance files /opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b_del
Nov 14 11:24:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Deletion of /opt/stack/data/nova/instances/68bca729-db5f-4edd-9549-979c5b00e49b_del complete
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.179s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:24:58 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:24:58 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8b04a8-4fd8-447a-a34d-de883c1db9c7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aPvybpSQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 11:24:58 user nova-compute[75255]: node.name = iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:24:58 user nova-compute[75255]: node.tpgt = -1
Nov 14 11:24:58 user nova-compute[75255]: node.startup = automatic
Nov 14 11:24:58 user nova-compute[75255]: node.leading_login = No
Nov 14 11:24:58 user nova-compute[75255]: iface.iscsi_ifacename = default
Nov 14 11:24:58 user nova-compute[75255]: iface.net_ifacename = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.ipaddress = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.prefix_len = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.hwaddress = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.transport_name = tcp
Nov 14 11:24:58 user nova-compute[75255]: iface.initiatorname = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.state = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.vlan_id = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.vlan_priority = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.vlan_state = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.iface_num = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.mtu = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.port = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.bootproto = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.subnet_mask = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.gateway = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_alt_client_id = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_dns = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_learn_iqn = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_vendor_id_state = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_vendor_id = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.dhcp_slp_da = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.fragmentation = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.gratuitous_arp = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.incoming_forwarding = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.tos_state = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.tos = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.ttl = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.delayed_ack = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.tcp_nagle = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.tcp_wsf_state = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.tcp_wsf = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.tcp_timer_scale = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.tcp_timestamp = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.redirect = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.def_task_mgmt_timeout = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.header_digest = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.data_digest = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.immediate_data = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.initial_r2t = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.data_seq_inorder = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.data_pdu_inorder = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.erl = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.max_receive_data_len = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.first_burst_len = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.max_outstanding_r2t = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.max_burst_len = 0
Nov 14 11:24:58 user nova-compute[75255]: iface.chap_auth = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.bidi_chap = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.strict_login_compliance = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.discovery_auth = <empty>
Nov 14 11:24:58 user nova-compute[75255]: iface.discovery_logout = <empty>
Nov 14 11:24:58 user nova-compute[75255]: node.discovery_address = <empty>
Nov 14 11:24:58 user nova-compute[75255]: node.discovery_port = 0
Nov 14 11:24:58 user nova-compute[75255]: node.discovery_type = static
Nov 14 11:24:58 user nova-compute[75255]: node.session.initial_cmdsn = 0
Nov 14 11:24:58 user nova-compute[75255]: node.session.initial_login_retry_max = 8
Nov 14 11:24:58 user nova-compute[75255]: node.session.xmit_thread_priority = -20
Nov 14 11:24:58 user nova-compute[75255]: node.session.cmds_max = 128
Nov 14 11:24:58 user nova-compute[75255]: node.session.queue_depth = 32
Nov 14 11:24:58 user nova-compute[75255]: node.session.nr_sessions = 1
Nov 14 11:24:58 user nova-compute[75255]: node.session.auth.authmethod = CHAP
Nov 14 11:24:58 user nova-compute[75255]: node.session.auth.username = aPvybpSQ
Nov 14 11:24:58 user nova-compute[75255]: node.session.auth.password = ***
Nov 14 11:24:58 user nova-compute[75255]: node.session.auth.username_in = <empty>
Nov 14 11:24:58 user nova-compute[75255]: node.session.auth.password_in = <empty>
Nov 14 11:24:58 user nova-compute[75255]: node.session.auth.chap_algs = MD5
Nov 14 11:24:58 user nova-compute[75255]: node.session.timeo.replacement_timeout = 120
Nov 14 11:24:58 user nova-compute[75255]: node.session.err_timeo.abort_timeout = 15
Nov 14 11:24:58 user nova-compute[75255]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 11:24:58 user nova-compute[75255]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 11:24:58 user nova-compute[75255]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.FastAbort = Yes
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.InitialR2T = No
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.ImmediateData = Yes
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.MaxConnections = 1
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 11:24:58 user nova-compute[75255]: node.session.iscsi.ERL = 0
Nov 14 11:24:58 user nova-compute[75255]: node.session.scan = manual
Nov 14 11:24:58 user nova-compute[75255]: node.session.reopen_max = 0
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].address = 172.16.0.220
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].port = 3260
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].startup = manual
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].tcp.window_size = 524288
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].tcp.type_of_service = 0
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].timeo.logout_timeout = 15
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].timeo.login_timeout = 15
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].timeo.auth_timeout = 45
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].iscsi.DataDigest = None
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].iscsi.IFMarker = No
Nov 14 11:24:58 user nova-compute[75255]: node.conn[0].iscsi.OFMarker = No
Nov 14 11:24:58 user nova-compute[75255]: # END RECORD
Nov 14 11:24:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dfe215-5383-49ad-afaa-ed1e21507cad]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: INFO nova.compute.manager [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3edfc45-8c0f-45e8-b69f-529f16588752]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPvybpSQ {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPvybpSQ" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70e1b6a-5c93-4dc4-ba5c-cb51b8f22f35]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aPvybpSQ'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0f3d4d-e5ea-4d65-bfa6-27adcf9afa08]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c29ee8a-fd4e-452d-815c-923ab0e263e0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:24:58 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:24:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:24:58 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:24:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] HCTL ('37', '0', '0', 0) found on session 39 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e514dae8-638f-4721-9f07-ca06e24c4307]: (4, ('0 0 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Searching for a device in session 39 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPvybpSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== connect_volume: return (349ms) {'type': 'block', 'scsi_wwn': '23232323032616235', 'path': '/dev/sdf'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232323032616235', 'path': '/dev/sdf'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369322017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369322017',id=33,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:23:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-1j5wk6bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:23:20Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=ae76487b-9360-43d4-b081-68186acc2565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "vif_mac": "fa:16:3e:e4:2e:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "vif_mac": "fa:16:3e:e4:2e:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'pci_devices' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.objects.base [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Object Instance<ae76487b-9360-43d4-b081-68186acc2565> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:24:58 user nova-compute[75255]:   <uuid>ae76487b-9360-43d4-b081-68186acc2565</uuid>
Nov 14 11:24:58 user nova-compute[75255]:   <name>instance-00000021</name>
Nov 14 11:24:58 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:24:58 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:24:58 user nova-compute[75255]:   <metadata>
Nov 14 11:24:58 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:24:58 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:24:58 user nova-compute[75255]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1369322017</nova:name>
Nov 14 11:24:58 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:24:58</nova:creationTime>
Nov 14 11:24:58 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:24:58 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:24:58 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:24:58 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:24:58 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:24:58 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:24:58 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:24:58 user nova-compute[75255]:       <nova:owner>
Nov 14 11:24:58 user nova-compute[75255]:         <nova:user uuid="3b82af4602b649889188f0f943c63896">tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member</nova:user>
Nov 14 11:24:58 user nova-compute[75255]:         <nova:project uuid="bbb07eaf3ea24939aeef6eba1bb2293d">tempest-ServerBootFromVolumeStableRescueTest-1912178200</nova:project>
Nov 14 11:24:58 user nova-compute[75255]:       </nova:owner>
Nov 14 11:24:58 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:24:58 user nova-compute[75255]:       <nova:ports>
Nov 14 11:24:58 user nova-compute[75255]:         <nova:port uuid="5962caa2-9c61-4cf6-bd36-0b9fc6153aed">
Nov 14 11:24:58 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:24:58 user nova-compute[75255]:         </nova:port>
Nov 14 11:24:58 user nova-compute[75255]:       </nova:ports>
Nov 14 11:24:58 user nova-compute[75255]:     </nova:instance>
Nov 14 11:24:58 user nova-compute[75255]:   </metadata>
Nov 14 11:24:58 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:24:58 user nova-compute[75255]:     <system>
Nov 14 11:24:58 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:24:58 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:24:58 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:24:58 user nova-compute[75255]:       <entry name="serial">ae76487b-9360-43d4-b081-68186acc2565</entry>
Nov 14 11:24:58 user nova-compute[75255]:       <entry name="uuid">ae76487b-9360-43d4-b081-68186acc2565</entry>
Nov 14 11:24:58 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:24:58 user nova-compute[75255]:     </system>
Nov 14 11:24:58 user nova-compute[75255]:   </sysinfo>
Nov 14 11:24:58 user nova-compute[75255]:   <os>
Nov 14 11:24:58 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:24:58 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:24:58 user nova-compute[75255]:   </os>
Nov 14 11:24:58 user nova-compute[75255]:   <features>
Nov 14 11:24:58 user nova-compute[75255]:     <acpi/>
Nov 14 11:24:58 user nova-compute[75255]:     <apic/>
Nov 14 11:24:58 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:24:58 user nova-compute[75255]:   </features>
Nov 14 11:24:58 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:24:58 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:24:58 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:24:58 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:24:58 user nova-compute[75255]:   </clock>
Nov 14 11:24:58 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:24:58 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:24:58 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:24:58 user nova-compute[75255]:   </cpu>
Nov 14 11:24:58 user nova-compute[75255]:   <devices>
Nov 14 11:24:58 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:24:58 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:24:58 user nova-compute[75255]:       <source dev="/dev/sdf"/>
Nov 14 11:24:58 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:24:58 user nova-compute[75255]:       <serial>ac19eea3-84bb-4271-bec4-e8d4b409ffd1</serial>
Nov 14 11:24:58 user nova-compute[75255]:     </disk>
Nov 14 11:24:58 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:24:58 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:24:58 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue"/>
Nov 14 11:24:58 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:24:58 user nova-compute[75255]:       <boot order="1"/>
Nov 14 11:24:58 user nova-compute[75255]:     </disk>
Nov 14 11:24:58 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:24:58 user nova-compute[75255]:       <mac address="fa:16:3e:e4:2e:93"/>
Nov 14 11:24:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:58 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:24:58 user nova-compute[75255]:       <target dev="tap5962caa2-9c"/>
Nov 14 11:24:58 user nova-compute[75255]:     </interface>
Nov 14 11:24:58 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:24:58 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/console.log" append="off"/>
Nov 14 11:24:58 user nova-compute[75255]:     </serial>
Nov 14 11:24:58 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:24:58 user nova-compute[75255]:     <video>
Nov 14 11:24:58 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:24:58 user nova-compute[75255]:     </video>
Nov 14 11:24:58 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:24:58 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:24:58 user nova-compute[75255]:     </rng>
Nov 14 11:24:58 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:24:58 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:24:58 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:24:58 user nova-compute[75255]:     </memballoon>
Nov 14 11:24:58 user nova-compute[75255]:   </devices>
Nov 14 11:24:58 user nova-compute[75255]: </domain>
Nov 14 11:24:58 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:24:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance destroyed successfully.
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] No VIF found with MAC fa:16:3e:e4:2e:93, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:24:58 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Took 0.47 seconds to deallocate network for instance.
Nov 14 11:24:58 user nova-compute[75255]: DEBUG nova.compute.manager [req-04ba5dbb-8270-40f8-92a6-cdd85fd1fff2 req-5c8379a8-5cb0-4798-a9b7-c98d7b606b74 service nova] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Received event network-vif-deleted-7a833ede-1eff-4e41-89ff-72ecc27b25bb {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:24:59 user nova-compute[75255]: INFO nova.compute.manager [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 11:24:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] [instance: 68bca729-db5f-4edd-9549-979c5b00e49b] Deleting volume: 48fbc53d-534d-4d32-8319-6cc35b8cf74b {{(pid=75255) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 11:24:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:24:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:24:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:24:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-e39f0a48-5e11-4b54-b000-579b36619133 req-70d8cb50-8206-4ea1-9336-ca58521fbf5b service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e39f0a48-5e11-4b54-b000-579b36619133 req-70d8cb50-8206-4ea1-9336-ca58521fbf5b service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e39f0a48-5e11-4b54-b000-579b36619133 req-70d8cb50-8206-4ea1-9336-ca58521fbf5b service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e39f0a48-5e11-4b54-b000-579b36619133 req-70d8cb50-8206-4ea1-9336-ca58521fbf5b service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-e39f0a48-5e11-4b54-b000-579b36619133 req-70d8cb50-8206-4ea1-9336-ca58521fbf5b service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:25:00 user nova-compute[75255]: WARNING nova.compute.manager [req-e39f0a48-5e11-4b54-b000-579b36619133 req-70d8cb50-8206-4ea1-9336-ca58521fbf5b service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state active and task_state rescuing.
Nov 14 11:25:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:00 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Deleted allocations for instance 68bca729-db5f-4edd-9549-979c5b00e49b
Nov 14 11:25:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-995ca10f-3694-41a9-a7a7-3a46891ee60d tempest-TestShelveInstance-1188210100 tempest-TestShelveInstance-1188210100-project-member] Lock "68bca729-db5f-4edd-9549-979c5b00e49b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.057s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-3b796319-f8a1-441b-b430-fd1de5306432 req-da080e7e-d59d-452a-afa5-30eb53f2f7d8 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3b796319-f8a1-441b-b430-fd1de5306432 req-da080e7e-d59d-452a-afa5-30eb53f2f7d8 service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3b796319-f8a1-441b-b430-fd1de5306432 req-da080e7e-d59d-452a-afa5-30eb53f2f7d8 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3b796319-f8a1-441b-b430-fd1de5306432 req-da080e7e-d59d-452a-afa5-30eb53f2f7d8 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-3b796319-f8a1-441b-b430-fd1de5306432 req-da080e7e-d59d-452a-afa5-30eb53f2f7d8 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:25:02 user nova-compute[75255]: WARNING nova.compute.manager [req-3b796319-f8a1-441b-b430-fd1de5306432 req-da080e7e-d59d-452a-afa5-30eb53f2f7d8 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state active and task_state rescuing.
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7a8b19d0-e6db-462a-950d-77fac814c81f tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Starting finish_migration {{(pid=75255) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance directory exists: not creating {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 11:25:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Creating image(s)
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Ensure instance console log exists: /opt/stack/data/nova/instances/eaf8bf74-7ef8-4eca-8098-0a675ca188cb/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Start _get_guest_xml network_info=[{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1050170865-network", "vif_mac": "fa:16:3e:2c:a0:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '741bbdcb-7aeb-4db0-ae16-4bad6c0f61b0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'eaf8bf74-7ef8-4eca-8098-0a675ca188cb', 'attached_at': '2023-11-14T11:25:03.000000', 'detached_at': '', 'volume_id': '5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'serial': '5963f401-2e5e-471e-a7ff-142a1caaa3cb'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:25:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:25:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:25:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:25:02 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:25:02 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:25:02 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0de877-db25-4599-b0d7-446c530b4fdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:25:02 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a70f6d-4832-43cb-8f92-a3908c702a72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb] added
Nov 14 11:25:02 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a040b-4f92-4adf-a337-1b765242b3aa]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[48851d15-fa24-4147-a9e3-021ccd21e27f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YioHzsSj {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YioHzsSj" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccc9df6-1522-41d0-a442-a1957acb5456]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YioHzsSj'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[998671dd-bc37-46d2-a135-37fea81ea920]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[942af50d-2e27-4897-ac47-8f9196faf545]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:25:03 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:25:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:25:03 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:25:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315f23d-ef4d-40c7-9325-e24f041faee4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]
Nov 14 11:25:03 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.
Nov 14 11:25:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c1ed3-d296-4655-bdd1-ea2216feb5fe]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8054e452-9df6-4016-9b02-10f195930dcd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:25:03 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:25:03 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:25:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:25:03 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:25:03 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:25:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c403ace-4e4c-4b0a-be5b-c1e5ee141e3a]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:25:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23631313765353637', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631313765353637', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112388371',display_name='tempest-ServerActionsTestOtherA-server-2112388371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112388371',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:23:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-2efmp59p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=eaf8bf74-7ef8-4eca-8098-0a675ca188cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1050170865-network", "vif_mac": "fa:16:3e:2c:a0:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1050170865-network", "vif_mac": "fa:16:3e:2c:a0:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:25:04 user nova-compute[75255]:   <uuid>eaf8bf74-7ef8-4eca-8098-0a675ca188cb</uuid>
Nov 14 11:25:04 user nova-compute[75255]:   <name>instance-00000020</name>
Nov 14 11:25:04 user nova-compute[75255]:   <memory>2097152</memory>
Nov 14 11:25:04 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:25:04 user nova-compute[75255]:   <metadata>
Nov 14 11:25:04 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:25:04 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:25:04 user nova-compute[75255]:       <nova:name>tempest-ServerActionsTestOtherA-server-2112388371</nova:name>
Nov 14 11:25:04 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:25:02</nova:creationTime>
Nov 14 11:25:04 user nova-compute[75255]:       <nova:flavor name="m1.small">
Nov 14 11:25:04 user nova-compute[75255]:         <nova:memory>2048</nova:memory>
Nov 14 11:25:04 user nova-compute[75255]:         <nova:disk>20</nova:disk>
Nov 14 11:25:04 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:25:04 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:25:04 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:25:04 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:25:04 user nova-compute[75255]:       <nova:owner>
Nov 14 11:25:04 user nova-compute[75255]:         <nova:user uuid="31467e0715d645ecbfbb209e8eba66ed">tempest-ServerActionsTestOtherA-1585033744-project-member</nova:user>
Nov 14 11:25:04 user nova-compute[75255]:         <nova:project uuid="3d1dfe665b5444728fff969e0156d205">tempest-ServerActionsTestOtherA-1585033744</nova:project>
Nov 14 11:25:04 user nova-compute[75255]:       </nova:owner>
Nov 14 11:25:04 user nova-compute[75255]:       <nova:ports>
Nov 14 11:25:04 user nova-compute[75255]:         <nova:port uuid="b1108729-e7e5-4de3-99ba-daf01a2ca472">
Nov 14 11:25:04 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:25:04 user nova-compute[75255]:         </nova:port>
Nov 14 11:25:04 user nova-compute[75255]:       </nova:ports>
Nov 14 11:25:04 user nova-compute[75255]:     </nova:instance>
Nov 14 11:25:04 user nova-compute[75255]:   </metadata>
Nov 14 11:25:04 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:25:04 user nova-compute[75255]:     <system>
Nov 14 11:25:04 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:25:04 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:25:04 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:25:04 user nova-compute[75255]:       <entry name="serial">eaf8bf74-7ef8-4eca-8098-0a675ca188cb</entry>
Nov 14 11:25:04 user nova-compute[75255]:       <entry name="uuid">eaf8bf74-7ef8-4eca-8098-0a675ca188cb</entry>
Nov 14 11:25:04 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:25:04 user nova-compute[75255]:     </system>
Nov 14 11:25:04 user nova-compute[75255]:   </sysinfo>
Nov 14 11:25:04 user nova-compute[75255]:   <os>
Nov 14 11:25:04 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:25:04 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:25:04 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:25:04 user nova-compute[75255]:   </os>
Nov 14 11:25:04 user nova-compute[75255]:   <features>
Nov 14 11:25:04 user nova-compute[75255]:     <acpi/>
Nov 14 11:25:04 user nova-compute[75255]:     <apic/>
Nov 14 11:25:04 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:25:04 user nova-compute[75255]:   </features>
Nov 14 11:25:04 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:25:04 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:25:04 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:25:04 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:25:04 user nova-compute[75255]:   </clock>
Nov 14 11:25:04 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:25:04 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:25:04 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:25:04 user nova-compute[75255]:   </cpu>
Nov 14 11:25:04 user nova-compute[75255]:   <devices>
Nov 14 11:25:04 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:25:04 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:25:04 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:25:04 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:25:04 user nova-compute[75255]:       <serial>5963f401-2e5e-471e-a7ff-142a1caaa3cb</serial>
Nov 14 11:25:04 user nova-compute[75255]:     </disk>
Nov 14 11:25:04 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:25:04 user nova-compute[75255]:       <mac address="fa:16:3e:2c:a0:12"/>
Nov 14 11:25:04 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:25:04 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:25:04 user nova-compute[75255]:       <target dev="tapb1108729-e7"/>
Nov 14 11:25:04 user nova-compute[75255]:     </interface>
Nov 14 11:25:04 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:25:04 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/eaf8bf74-7ef8-4eca-8098-0a675ca188cb/console.log" append="off"/>
Nov 14 11:25:04 user nova-compute[75255]:     </serial>
Nov 14 11:25:04 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:25:04 user nova-compute[75255]:     <video>
Nov 14 11:25:04 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:25:04 user nova-compute[75255]:     </video>
Nov 14 11:25:04 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:25:04 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:25:04 user nova-compute[75255]:     </rng>
Nov 14 11:25:04 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:25:04 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:25:04 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:25:04 user nova-compute[75255]:     </memballoon>
Nov 14 11:25:04 user nova-compute[75255]:   </devices>
Nov 14 11:25:04 user nova-compute[75255]: </domain>
Nov 14 11:25:04 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112388371',display_name='tempest-ServerActionsTestOtherA-server-2112388371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112388371',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:23:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-2efmp59p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=eaf8bf74-7ef8-4eca-8098-0a675ca188cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1050170865-network", "vif_mac": "fa:16:3e:2c:a0:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1050170865-network", "vif_mac": "fa:16:3e:2c:a0:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG os_vif [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28d454d2-4e01-56d2-ae33-65ba160b91c5', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1108729-e7, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1108729-e7, col_values=(('qos', UUID('dc538dca-26da-47a2-8ec4-acc23d5353e1')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1108729-e7, col_values=(('external_ids', {'iface-id': 'b1108729-e7e5-4de3-99ba-daf01a2ca472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:a0:12', 'vm-uuid': 'eaf8bf74-7ef8-4eca-8098-0a675ca188cb'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:04 user nova-compute[75255]: INFO os_vif [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7')
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] No VIF found with MAC fa:16:3e:2c:a0:12, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:25:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-bad95861-abad-45fe-9c7c-92b0a287db7e req-6c5b71d1-c212-4700-a8c1-e28b257b9455 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bad95861-abad-45fe-9c7c-92b0a287db7e req-6c5b71d1-c212-4700-a8c1-e28b257b9455 service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bad95861-abad-45fe-9c7c-92b0a287db7e req-6c5b71d1-c212-4700-a8c1-e28b257b9455 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bad95861-abad-45fe-9c7c-92b0a287db7e req-6c5b71d1-c212-4700-a8c1-e28b257b9455 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-bad95861-abad-45fe-9c7c-92b0a287db7e req-6c5b71d1-c212-4700-a8c1-e28b257b9455 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:25:05 user nova-compute[75255]: WARNING nova.compute.manager [req-bad95861-abad-45fe-9c7c-92b0a287db7e req-6c5b71d1-c212-4700-a8c1-e28b257b9455 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received unexpected event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with vm_state active and task_state resize_finish.
Nov 14 11:25:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:25:07 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance running successfully.
Nov 14 11:25:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Failed to set time: agent not configured {{(pid=75255) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 11:25:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-00caef02-f435-427c-a1ea-3b70299c17bf tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] finish_migration finished successfully. {{(pid=75255) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 11:25:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b335535-2267-4fb4-9cee-dbbd5e0bd683 req-17e623a7-d490-4497-95ef-0ecd747acbcf service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:25:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b335535-2267-4fb4-9cee-dbbd5e0bd683 req-17e623a7-d490-4497-95ef-0ecd747acbcf service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:25:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b335535-2267-4fb4-9cee-dbbd5e0bd683 req-17e623a7-d490-4497-95ef-0ecd747acbcf service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:25:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6b335535-2267-4fb4-9cee-dbbd5e0bd683 req-17e623a7-d490-4497-95ef-0ecd747acbcf service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-6b335535-2267-4fb4-9cee-dbbd5e0bd683 req-17e623a7-d490-4497-95ef-0ecd747acbcf service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:25:07 user nova-compute[75255]: WARNING nova.compute.manager [req-6b335535-2267-4fb4-9cee-dbbd5e0bd683 req-17e623a7-d490-4497-95ef-0ecd747acbcf service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received unexpected event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with vm_state active and task_state resize_finish.
Nov 14 11:25:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:25:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:25:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:25:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:25:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:30 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:25:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:25:42 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:25:42 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=7956MB free_disk=24.96893310546875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Applying migration context for instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb as it has an incoming, in-progress migration 6aa6d7a1-5ad7-449f-a4de-6fbbe96d78a1. Migration status is finished {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 11:25:42 user nova-compute[75255]: INFO nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating resource usage from migration 6aa6d7a1-5ad7-449f-a4de-6fbbe96d78a1
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ae76487b-9360-43d4-b081-68186acc2565 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance aa807cc9-5175-4b36-8210-7cef688b71c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance a479fa6c-e55a-4751-b98f-6b4b5458b681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Migration 6aa6d7a1-5ad7-449f-a4de-6fbbe96d78a1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:25:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:25:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:25:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [{"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-8d0e0752-e32b-4696-abb1-9ca53cae10fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:25:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:25:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:25:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:26:08 user nova-compute[75255]: INFO nova.compute.claims [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Claim successful on node user
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:26:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:26:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.policy [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4e5f5081c1b4691a79b2839bfc8c124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9282a36a740403f8a65ede3b9405d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:26:09 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Creating image(s)
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "/opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "/opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk 1073741824" returned: 0 in 0.066s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Successfully created port: 3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Cannot resize image /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Ensure instance console log exists: /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing instance network info cache due to event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Successfully updated port: 3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquired lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-changed-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Refreshing instance network info cache due to event network-changed-3df945d4-067c-4ff3-812d-f020c97468f9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] Acquiring lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating instance_info_cache with network_info: [{"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Releasing lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Instance network_info: |[{"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] Acquired lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Refreshing network info cache for port 3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Start _get_guest_xml network_info=[{"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updated VIF entry in instance network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:26:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-669989355',display_name='tempest-TestStampPattern-server-669989355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-669989355',id=37,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+K+knKpNyZnoq/fwoIWr7QItDZQ5aLjEM7xC051cHvbV98q9oTME1VV23X8TxAqVI6fYWttj3e2KZ5Vhxbye8R2SGnCj7WIl6zRE+W17wWjn1nejVZq2nLaP4MQnIrw==',key_name='tempest-TestStampPattern-1486227609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9282a36a740403f8a65ede3b9405d22',ramdisk_id='',reservation_id='r-igsacede',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-761473602',owner_user_name='tempest-TestStampPattern-761473602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:26:09Z,user_data=None,user_id='a4e5f5081c1b4691a79b2839bfc8c124',uuid=d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converting VIF {"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=3df945d4-067c-4ff3-812d-f020c97468f9,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df945d4-06') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'pci_devices' on Instance uuid d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8223bd0a-64ef-4b15-86b6-24af3db317d1 req-8a74b108-5f0e-48b1-b4b5-3786f9e803f9 service nova] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:26:10 user nova-compute[75255]:   <uuid>d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a</uuid>
Nov 14 11:26:10 user nova-compute[75255]:   <name>instance-00000025</name>
Nov 14 11:26:10 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:26:10 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:26:10 user nova-compute[75255]:   <metadata>
Nov 14 11:26:10 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:26:10 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:26:10 user nova-compute[75255]:       <nova:name>tempest-TestStampPattern-server-669989355</nova:name>
Nov 14 11:26:10 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:26:10</nova:creationTime>
Nov 14 11:26:10 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:26:10 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:26:10 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:26:10 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:26:10 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:26:10 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:26:10 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:26:10 user nova-compute[75255]:       <nova:owner>
Nov 14 11:26:10 user nova-compute[75255]:         <nova:user uuid="a4e5f5081c1b4691a79b2839bfc8c124">tempest-TestStampPattern-761473602-project-member</nova:user>
Nov 14 11:26:10 user nova-compute[75255]:         <nova:project uuid="c9282a36a740403f8a65ede3b9405d22">tempest-TestStampPattern-761473602</nova:project>
Nov 14 11:26:10 user nova-compute[75255]:       </nova:owner>
Nov 14 11:26:10 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:26:10 user nova-compute[75255]:       <nova:ports>
Nov 14 11:26:10 user nova-compute[75255]:         <nova:port uuid="3df945d4-067c-4ff3-812d-f020c97468f9">
Nov 14 11:26:10 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 11:26:10 user nova-compute[75255]:         </nova:port>
Nov 14 11:26:10 user nova-compute[75255]:       </nova:ports>
Nov 14 11:26:10 user nova-compute[75255]:     </nova:instance>
Nov 14 11:26:10 user nova-compute[75255]:   </metadata>
Nov 14 11:26:10 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:26:10 user nova-compute[75255]:     <system>
Nov 14 11:26:10 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:26:10 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:26:10 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:26:10 user nova-compute[75255]:       <entry name="serial">d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a</entry>
Nov 14 11:26:10 user nova-compute[75255]:       <entry name="uuid">d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a</entry>
Nov 14 11:26:10 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:26:10 user nova-compute[75255]:     </system>
Nov 14 11:26:10 user nova-compute[75255]:   </sysinfo>
Nov 14 11:26:10 user nova-compute[75255]:   <os>
Nov 14 11:26:10 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:26:10 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:26:10 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:26:10 user nova-compute[75255]:   </os>
Nov 14 11:26:10 user nova-compute[75255]:   <features>
Nov 14 11:26:10 user nova-compute[75255]:     <acpi/>
Nov 14 11:26:10 user nova-compute[75255]:     <apic/>
Nov 14 11:26:10 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:26:10 user nova-compute[75255]:   </features>
Nov 14 11:26:10 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:26:10 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:26:10 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:26:10 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:26:10 user nova-compute[75255]:   </clock>
Nov 14 11:26:10 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:26:10 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:26:10 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:26:10 user nova-compute[75255]:   </cpu>
Nov 14 11:26:10 user nova-compute[75255]:   <devices>
Nov 14 11:26:10 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:26:10 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:26:10 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk"/>
Nov 14 11:26:10 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:26:10 user nova-compute[75255]:     </disk>
Nov 14 11:26:10 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:26:10 user nova-compute[75255]:       <mac address="fa:16:3e:c2:97:b1"/>
Nov 14 11:26:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:26:10 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:26:10 user nova-compute[75255]:       <target dev="tap3df945d4-06"/>
Nov 14 11:26:10 user nova-compute[75255]:     </interface>
Nov 14 11:26:10 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:26:10 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/console.log" append="off"/>
Nov 14 11:26:10 user nova-compute[75255]:     </serial>
Nov 14 11:26:10 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:26:10 user nova-compute[75255]:     <video>
Nov 14 11:26:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:26:10 user nova-compute[75255]:     </video>
Nov 14 11:26:10 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:26:10 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:26:10 user nova-compute[75255]:     </rng>
Nov 14 11:26:10 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:26:10 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:26:10 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:26:10 user nova-compute[75255]:     </memballoon>
Nov 14 11:26:10 user nova-compute[75255]:   </devices>
Nov 14 11:26:10 user nova-compute[75255]: </domain>
Nov 14 11:26:10 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-669989355',display_name='tempest-TestStampPattern-server-669989355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-669989355',id=37,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+K+knKpNyZnoq/fwoIWr7QItDZQ5aLjEM7xC051cHvbV98q9oTME1VV23X8TxAqVI6fYWttj3e2KZ5Vhxbye8R2SGnCj7WIl6zRE+W17wWjn1nejVZq2nLaP4MQnIrw==',key_name='tempest-TestStampPattern-1486227609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9282a36a740403f8a65ede3b9405d22',ramdisk_id='',reservation_id='r-igsacede',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-761473602',owner_user_name='tempest-TestStampPattern-761473602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:26:09Z,user_data=None,user_id='a4e5f5081c1b4691a79b2839bfc8c124',uuid=d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converting VIF {"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=3df945d4-067c-4ff3-812d-f020c97468f9,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df945d4-06') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG os_vif [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=3df945d4-067c-4ff3-812d-f020c97468f9,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df945d4-06') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1218c685-6c4b-532b-a43d-b1bdb00f825a', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3df945d4-06, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3df945d4-06, col_values=(('qos', UUID('c43c1dc9-6b3a-490d-9e98-c9bda3223daf')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3df945d4-06, col_values=(('external_ids', {'iface-id': '3df945d4-067c-4ff3-812d-f020c97468f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:97:b1', 'vm-uuid': 'd0aef4a6-0aea-4d6f-82e0-6e79abaeb79a'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:10 user nova-compute[75255]: INFO os_vif [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=3df945d4-067c-4ff3-812d-f020c97468f9,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df945d4-06')
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No VIF found with MAC fa:16:3e:c2:97:b1, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updated VIF entry in instance network info cache for port 3df945d4-067c-4ff3-812d-f020c97468f9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:26:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating instance_info_cache with network_info: [{"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2c979056-f81f-4060-be14-81e876f667d0 req-3009eeb5-9003-4e01-92ab-2ab4806e0f09 service nova] Releasing lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-0dcf1d69-9489-46b9-9035-33042705ecfd req-ffa2d396-b5e1-42a3-b741-a98d1cd30d4b service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0dcf1d69-9489-46b9-9035-33042705ecfd req-ffa2d396-b5e1-42a3-b741-a98d1cd30d4b service nova] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0dcf1d69-9489-46b9-9035-33042705ecfd req-ffa2d396-b5e1-42a3-b741-a98d1cd30d4b service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0dcf1d69-9489-46b9-9035-33042705ecfd req-ffa2d396-b5e1-42a3-b741-a98d1cd30d4b service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-0dcf1d69-9489-46b9-9035-33042705ecfd req-ffa2d396-b5e1-42a3-b741-a98d1cd30d4b service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] No waiting events found dispatching network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:12 user nova-compute[75255]: WARNING nova.compute.manager [req-0dcf1d69-9489-46b9-9035-33042705ecfd req-ffa2d396-b5e1-42a3-b741-a98d1cd30d4b service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received unexpected event network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 for instance with vm_state building and task_state spawning.
Nov 14 11:26:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:12 user nova-compute[75255]: INFO nova.compute.manager [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Shelving
Nov 14 11:26:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-changed-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Refreshing instance network info cache due to event network-changed-d8c74dba-f494-4742-8a24-cc6f01cae599. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] Acquiring lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] Acquired lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Refreshing network info cache for port d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'flavor' on Instance uuid aa807cc9-5175-4b36-8210-7cef688b71c1 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Ignoring supplied device name: /dev/vdb
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:13 user nova-compute[75255]: INFO nova.compute.manager [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Attaching volume 4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 to /dev/vdb
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Updated VIF entry in instance network info cache for port d8c74dba-f494-4742-8a24-cc6f01cae599. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Updating instance_info_cache with network_info: [{"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-934dcbd0-8132-402f-a736-be5bcd39112f req-53b93a37-8746-4621-aed9-0df906bb420a service nova] Releasing lock "refresh_cache-aa807cc9-5175-4b36-8210-7cef688b71c1" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG os_brick.utils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0df09-0f13-481c-8f3b-055eeb922cf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f4e253-b978-4924-ac8d-0e33487501e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6014128d-f267-4881-959d-d93f050f50d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[951b3975-efed-4311-9f64-dc17fa416bd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance destroyed successfully.
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:26:13 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bf72e0-04e1-40e1-a23d-fc0bc82d7daa]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG os_brick.utils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Updating existing volume attachment record: e2001149-3439-41af-9109-06d1003d810b {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:26:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Beginning cold snapshot process
Nov 14 11:26:13 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:26:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk /opt/stack/data/nova/instances/snapshots/tmpqupi82wc/17f01a8a10524eb5b540b08c6643e3b1 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:26:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Instance spawned successfully.
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-486708a9-9971-4204-9de1-8576d7f8ac4e req-3535d854-ecf3-449f-8157-d8da1da73bc7 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-486708a9-9971-4204-9de1-8576d7f8ac4e req-3535d854-ecf3-449f-8157-d8da1da73bc7 service nova] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-486708a9-9971-4204-9de1-8576d7f8ac4e req-3535d854-ecf3-449f-8157-d8da1da73bc7 service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-486708a9-9971-4204-9de1-8576d7f8ac4e req-3535d854-ecf3-449f-8157-d8da1da73bc7 service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-486708a9-9971-4204-9de1-8576d7f8ac4e req-3535d854-ecf3-449f-8157-d8da1da73bc7 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] No waiting events found dispatching network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:14 user nova-compute[75255]: WARNING nova.compute.manager [req-486708a9-9971-4204-9de1-8576d7f8ac4e req-3535d854-ecf3-449f-8157-d8da1da73bc7 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received unexpected event network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 for instance with vm_state building and task_state spawning.
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:26:14 user nova-compute[75255]: INFO nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 14 11:26:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk /opt/stack/data/nova/instances/snapshots/tmpqupi82wc/17f01a8a10524eb5b540b08c6643e3b1" returned: 0 in 0.552s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Snapshot extracted, beginning image upload
Nov 14 11:26:14 user nova-compute[75255]: INFO nova.compute.manager [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Took 6.34 seconds to build instance.
Nov 14 11:26:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8b75be45-9152-47d4-bf38-5950973d53c9 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.441s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-unplugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-unplugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:15 user nova-compute[75255]: WARNING nova.compute.manager [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received unexpected event network-vif-unplugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 11:26:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:15 user nova-compute[75255]: WARNING nova.compute.manager [req-5127beab-6ca4-416a-9073-89bca81b2105 req-a3483253-c653-4211-a74b-e938cba32605 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received unexpected event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 11:26:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "a479fa6c-e55a-4751-b98f-6b4b5458b681" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.compute.manager [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Terminating instance
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Snapshot image upload complete
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.compute.manager [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Shelve offloading
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance destroyed successfully.
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-f84f38cc-3701-4836-9655-dac37b7faa30 req-4e83c978-66ca-45a9-9d16-5328a5ea7543 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received event network-vif-unplugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f84f38cc-3701-4836-9655-dac37b7faa30 req-4e83c978-66ca-45a9-9d16-5328a5ea7543 service nova] Acquiring lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f84f38cc-3701-4836-9655-dac37b7faa30 req-4e83c978-66ca-45a9-9d16-5328a5ea7543 service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f84f38cc-3701-4836-9655-dac37b7faa30 req-4e83c978-66ca-45a9-9d16-5328a5ea7543 service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-f84f38cc-3701-4836-9655-dac37b7faa30 req-4e83c978-66ca-45a9-9d16-5328a5ea7543 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] No waiting events found dispatching network-vif-unplugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-f84f38cc-3701-4836-9655-dac37b7faa30 req-4e83c978-66ca-45a9-9d16-5328a5ea7543 service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received event network-vif-unplugged-f744e2d5-101b-4f1c-af9b-722a24611680 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Instance destroyed successfully.
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lazy-loading 'resources' on Instance uuid a479fa6c-e55a-4751-b98f-6b4b5458b681 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1438842001',display_name='tempest-VolumesNegativeTest-instance-1438842001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1438842001',id=36,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:24:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03d3a0e09f084b8aabcb048bb5e9fb84',ramdisk_id='',reservation_id='r-vnlf9uh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-553619403',owner_user_name='tempest-VolumesNegativeTest-553619403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:24:34Z,user_data=None,user_id='69bb454dba1740fc84bdc054b8378f7c',uuid=a479fa6c-e55a-4751-b98f-6b4b5458b681,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Converting VIF {"id": "f744e2d5-101b-4f1c-af9b-722a24611680", "address": "fa:16:3e:0e:61:57", "network": {"id": "ef384ab3-91fb-4d75-a862-e303905326ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de9682d5d8634919aa7c4974ac5bbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf744e2d5-10", "ovs_interfaceid": "f744e2d5-101b-4f1c-af9b-722a24611680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:61:57,bridge_name='br-int',has_traffic_filtering=True,id=f744e2d5-101b-4f1c-af9b-722a24611680,network=Network(ef384ab3-91fb-4d75-a862-e303905326ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf744e2d5-10') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG os_vif [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:61:57,bridge_name='br-int',has_traffic_filtering=True,id=f744e2d5-101b-4f1c-af9b-722a24611680,network=Network(ef384ab3-91fb-4d75-a862-e303905326ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf744e2d5-10') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf744e2d5-10, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab5da0fb-5ce4-41d8-b640-57cc9128fc55) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:17 user nova-compute[75255]: INFO os_vif [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:61:57,bridge_name='br-int',has_traffic_filtering=True,id=f744e2d5-101b-4f1c-af9b-722a24611680,network=Network(ef384ab3-91fb-4d75-a862-e303905326ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf744e2d5-10')
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Deleting instance files /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681_del
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Deletion of /opt/stack/data/nova/instances/a479fa6c-e55a-4751-b98f-6b4b5458b681_del complete
Nov 14 11:26:17 user nova-compute[75255]: INFO nova.compute.manager [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 14 11:26:17 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:26:17 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:18 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Took 0.49 seconds to deallocate network for instance.
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-3f48db58-57c9-44d1-ba2a-bbb8a12752d7 req-988bae69-9b1e-47b9-bbae-5d962f14156b service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received event network-vif-deleted-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPUtOJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:26:18 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:26:18 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:26:18 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[348fa6e7-ec17-4d4b-aa43-439f61747749]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:26:18 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62d9be-1c4b-4495-99c8-2f8537570cf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35] added
Nov 14 11:26:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc1c34-d5ca-4d2f-8a7f-097e1d58b2b1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd92550a-7c68-4ef7-a306-aae9ebd3c9bb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPUtOJeX {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPUtOJeX" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f23b2-8f9f-49f0-94ed-428f27398876]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPUtOJeX'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fed823-1b03-4184-a7ea-0727550df6f5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c121053-a67f-4ebf-97b5-e9cd172e0f01]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance destroyed successfully.
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'resources' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984960086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984960086',id=34,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkig5pg750P4RIFQnqNLC/Mj9a0A19astPZfi6byTXL6e6EfI3unEeWVANHnucwQKGZRidB6ciCLZOg4qqyrZIl6EnDHhsUbPcN08n0FQuCBZRCo7ozmRH+1BoerVVygA==',key_name='tempest-keypair-1100144298',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-90adzxhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member',shelved_at='2023-11-14T11:26:17.470147',shelved_host='user',shelved_image_id='64436a2e-5afb-47b3-b3a1-99de9dca0250'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:26:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=7976be6c-afb4-4ddf-ac33-ddbd8a23265e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_vif [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing instance network info cache due to event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe93b8c3-8a, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57e10168-e5bb-4eba-a18f-004df566a267) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[84448168-6140-4486-89b3-8d0decd01f6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260]
Nov 14 11:26:18 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260] successful.
Nov 14 11:26:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: INFO os_vif [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a')
Nov 14 11:26:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Deleting instance files /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e_del
Nov 14 11:26:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Deletion of /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e_del complete
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffa4024-ea44-4fc9-bfaf-8125e65394de]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6b36ec-2b46-481b-a023-e3f4ca4c5090]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 (non-flash)
Nov 14 11:26:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:18 user nova-compute[75255]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 (non-flash)
Nov 14 11:26:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[53613ae7-4fb3-4bcf-a792-49f55f9ff0b6]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPUtOJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:26:18 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Deleted allocations for instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:26:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.027s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.objects.instance [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'numa_topology' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.objects.base [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<7976be6c-afb4-4ddf-ac33-ddbd8a23265e> lazy-loaded attributes: resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:26:19 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Deleted allocations for instance a479fa6c-e55a-4751-b98f-6b4b5458b681
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8efce5ce-07cd-4425-b30c-a2f5ce01147d tempest-VolumesNegativeTest-553619403 tempest-VolumesNegativeTest-553619403-project-member] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updated VIF entry in instance network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.network.neutron [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f2aa17f2-d1df-475f-a722-90dde6af77a2 req-6fcb1f73-2cc1-4f1e-9e78-7bce0b6f6b8b service nova] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2af64053-b84f-4b83-9ed2-3336b46fd18b tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.713s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-6f246462-8167-4d2c-a821-2e3f06cfb320 req-8552b1fd-e27d-45f7-9365-f284069934cd service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received event network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6f246462-8167-4d2c-a821-2e3f06cfb320 req-8552b1fd-e27d-45f7-9365-f284069934cd service nova] Acquiring lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6f246462-8167-4d2c-a821-2e3f06cfb320 req-8552b1fd-e27d-45f7-9365-f284069934cd service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6f246462-8167-4d2c-a821-2e3f06cfb320 req-8552b1fd-e27d-45f7-9365-f284069934cd service nova] Lock "a479fa6c-e55a-4751-b98f-6b4b5458b681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-6f246462-8167-4d2c-a821-2e3f06cfb320 req-8552b1fd-e27d-45f7-9365-f284069934cd service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] No waiting events found dispatching network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:19 user nova-compute[75255]: WARNING nova.compute.manager [req-6f246462-8167-4d2c-a821-2e3f06cfb320 req-8552b1fd-e27d-45f7-9365-f284069934cd service nova] [instance: a479fa6c-e55a-4751-b98f-6b4b5458b681] Received unexpected event network-vif-plugged-f744e2d5-101b-4f1c-af9b-722a24611680 for instance with vm_state deleted and task_state None.
Nov 14 11:26:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23763663066613761', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763663066613761', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'flavor' on Instance uuid aa807cc9-5175-4b36-8210-7cef688b71c1 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:26:19 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:26:19 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:26:19 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:26:19 user nova-compute[75255]:   <serial>4a1d53a5-816c-48a1-8bc5-c23e08fb7c35</serial>
Nov 14 11:26:19 user nova-compute[75255]: </disk>
Nov 14 11:26:19 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:26:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:26:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:26:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] No VIF found with MAC fa:16:3e:5e:22:f6, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:26:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7aea7dd7-777e-424b-8510-d66b267a03e5 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:27 user nova-compute[75255]: INFO nova.compute.manager [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Detaching volume 4a1d53a5-816c-48a1-8bc5-c23e08fb7c35
Nov 14 11:26:27 user nova-compute[75255]: INFO nova.virt.block_device [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Attempting to driver detach volume 4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 from mountpoint /dev/vdb
Nov 14 11:26:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Attempting to detach device vdb from instance aa807cc9-5175-4b36-8210-7cef688b71c1 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:26:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:26:27 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:26:27 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:26:27 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:26:27 user nova-compute[75255]:   <serial>4a1d53a5-816c-48a1-8bc5-c23e08fb7c35</serial>
Nov 14 11:26:27 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:26:27 user nova-compute[75255]: </disk>
Nov 14 11:26:27 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:26:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully detached device vdb from instance aa807cc9-5175-4b36-8210-7cef688b71c1 from the persistent domain config.
Nov 14 11:26:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa807cc9-5175-4b36-8210-7cef688b71c1 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:26:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:26:27 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:26:27 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:26:27 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:26:27 user nova-compute[75255]:   <serial>4a1d53a5-816c-48a1-8bc5-c23e08fb7c35</serial>
Nov 14 11:26:27 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:26:27 user nova-compute[75255]: </disk>
Nov 14 11:26:27 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:26:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa807cc9-5175-4b36-8210-7cef688b71c1 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:26:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:31 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Going to confirm migration 2 {{(pid=75255) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquired lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:26:41 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'info_cache' on Instance uuid eaf8bf74-7ef8-4eca-8098-0a675ca188cb {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Releasing lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'migration_context' on Instance uuid eaf8bf74-7ef8-4eca-8098-0a675ca188cb {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG nova.objects.base [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Object Instance<eaf8bf74-7ef8-4eca-8098-0a675ca188cb> lazy-loaded attributes: info_cache,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.457s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:43 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Deleted allocation for migration 6aa6d7a1-5ad7-449f-a4de-6fbbe96d78a1
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8de63fd6-af72-4b40-995c-3180a32fe0b8 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.727s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:43 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:26:43 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8040MB free_disk=24.943744659423828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ae76487b-9360-43d4-b081-68186acc2565 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance aa807cc9-5175-4b36-8210-7cef688b71c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:26:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:26:44 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:26:44 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:26:44 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:26:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:44 user nova-compute[75255]: INFO nova.compute.manager [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Unrescuing
Nov 14 11:26:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquired lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Updating instance_info_cache with network_info: [{"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Releasing lock "refresh_cache-ae76487b-9360-43d4-b081-68186acc2565" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'flavor' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-87e56abf-0895-4e4a-973e-3f368e96ff1b req-69d3b287-7b49-4ee8-920d-d0e65d8e58d4 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-87e56abf-0895-4e4a-973e-3f368e96ff1b req-69d3b287-7b49-4ee8-920d-d0e65d8e58d4 service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-87e56abf-0895-4e4a-973e-3f368e96ff1b req-69d3b287-7b49-4ee8-920d-d0e65d8e58d4 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-87e56abf-0895-4e4a-973e-3f368e96ff1b req-69d3b287-7b49-4ee8-920d-d0e65d8e58d4 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-87e56abf-0895-4e4a-973e-3f368e96ff1b req-69d3b287-7b49-4ee8-920d-d0e65d8e58d4 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:45 user nova-compute[75255]: WARNING nova.compute.manager [req-87e56abf-0895-4e4a-973e-3f368e96ff1b req-69d3b287-7b49-4ee8-920d-d0e65d8e58d4 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:26:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance destroyed successfully.
Nov 14 11:26:46 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:47 user nova-compute[75255]: WARNING nova.compute.manager [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:26:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:47 user nova-compute[75255]: WARNING nova.compute.manager [req-40508ea8-9846-4afe-a3a8-6a8f148c332a req-8cda8c54-cda8-457b-8e73-35862a763a3d service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state rescued and task_state unrescuing.
Nov 14 11:26:47 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aa807cc9-5175-4b36-8210-7cef688b71c1 is timed out.
Nov 14 11:26:47 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully detached device vdb from instance aa807cc9-5175-4b36-8210-7cef688b71c1 from the live domain config.
Nov 14 11:26:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPUtOJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:26:47 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b65b6-cad4-477e-a95a-71ce3e8e0875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:26:47 user nova-compute[75255]: No targets found.
Nov 14 11:26:47 user nova-compute[75255]: iSNS:
Nov 14 11:26:47 user nova-compute[75255]: No targets found.
Nov 14 11:26:47 user nova-compute[75255]: STATIC:
Nov 14 11:26:47 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:26:47 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:26:47 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:26:47 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35
Nov 14 11:26:47 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:26:47 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:26:47 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:26:47 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:26:47 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:26:47 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:26:47 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:26:47 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:26:47 user nova-compute[75255]: FIRMWARE:
Nov 14 11:26:47 user nova-compute[75255]: No targets found.
Nov 14 11:26:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:26:47 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:26:47 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ab1cdb-714a-4332-94ee-9141708ee26b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf96484-576d-4494-9196-6870d3a699f2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:47 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:47 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:47 user nova-compute[75255]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 (non-flash)
Nov 14 11:26:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:47 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:47 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:47 user nova-compute[75255]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 (non-flash)
Nov 14 11:26:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe900aa-f3dd-40d6-889d-98c89868e657]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe38f96f-4be5-47f4-b96b-7c33e4afedb1]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b1a73-8f3a-4fe2-a4c5-b358fa8e5433]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:26:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b29b5b-e76b-4949-9052-a17a1c4f61bb]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b9a62e-8477-436a-81cb-7970287f39b1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0069bfc5-1dfd-4741-ab1a-49442d83b419]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260]
Nov 14 11:26:48 user nova-compute[75255]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35, portal: 172.16.0.220,3260] successful.
Nov 14 11:26:48 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ad11b5-704b-48e6-83e6-248924bb0b9c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== disconnect_volume: return (297ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [{"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-427d469e-db0a-48ef-bbed-92e8d7ad61fe" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:48 user nova-compute[75255]: DEBUG nova.objects.instance [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'flavor' on Instance uuid aa807cc9-5175-4b36-8210-7cef688b71c1 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cfa5c78d-fac4-451b-a386-65601893d251 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.650s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:49 user nova-compute[75255]: INFO nova.compute.manager [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Terminating instance
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-e9bb1d25-cb4b-469f-936d-7905dc425d35 req-ab4fe5f0-f33d-4b17-8896-1ba7426531b2 service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-vif-unplugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e9bb1d25-cb4b-469f-936d-7905dc425d35 req-ab4fe5f0-f33d-4b17-8896-1ba7426531b2 service nova] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e9bb1d25-cb4b-469f-936d-7905dc425d35 req-ab4fe5f0-f33d-4b17-8896-1ba7426531b2 service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e9bb1d25-cb4b-469f-936d-7905dc425d35 req-ab4fe5f0-f33d-4b17-8896-1ba7426531b2 service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-e9bb1d25-cb4b-469f-936d-7905dc425d35 req-ab4fe5f0-f33d-4b17-8896-1ba7426531b2 service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] No waiting events found dispatching network-vif-unplugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-e9bb1d25-cb4b-469f-936d-7905dc425d35 req-ab4fe5f0-f33d-4b17-8896-1ba7426531b2 service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-vif-unplugged-d8c74dba-f494-4742-8a24-cc6f01cae599 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3608ccf2-cb7d-4eaf-86a5-b551563545bd tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-34ec2d82-76bd-48dd-b64d-7f4509552ae0 req-5189c784-6122-41be-8767-6108ae734125 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34ec2d82-76bd-48dd-b64d-7f4509552ae0 req-5189c784-6122-41be-8767-6108ae734125 service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34ec2d82-76bd-48dd-b64d-7f4509552ae0 req-5189c784-6122-41be-8767-6108ae734125 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-34ec2d82-76bd-48dd-b64d-7f4509552ae0 req-5189c784-6122-41be-8767-6108ae734125 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-34ec2d82-76bd-48dd-b64d-7f4509552ae0 req-5189c784-6122-41be-8767-6108ae734125 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:49 user nova-compute[75255]: WARNING nova.compute.manager [req-34ec2d82-76bd-48dd-b64d-7f4509552ae0 req-5189c784-6122-41be-8767-6108ae734125 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state active and task_state None.
Nov 14 11:26:49 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Instance destroyed successfully.
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.objects.instance [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lazy-loading 'resources' on Instance uuid aa807cc9-5175-4b36-8210-7cef688b71c1 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-577568692',display_name='tempest-VolumesSnapshotTestJSON-instance-577568692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-577568692',id=35,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVAymGUGdQ0bqruXVB0G41a1e3ucM3H6Y5QbjtbFP6aREVqE0dqi2Kb09v0QpKGH7xr89UEYYJMqzXFWETTQoiu5/gZ+tz70gVH4NzqH/h5H6CeEoSYlf9SN4pts17OAg==',key_name='tempest-keypair-612809553',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ddf20982f454dd4a1c831e064b41ec6',ramdisk_id='',reservation_id='r-ybale95o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-610019682',owner_user_name='tempest-VolumesSnapshotTestJSON-610019682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d356b8218514e458c45ec3066bad892',uuid=aa807cc9-5175-4b36-8210-7cef688b71c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converting VIF {"id": "d8c74dba-f494-4742-8a24-cc6f01cae599", "address": "fa:16:3e:5e:22:f6", "network": {"id": "4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1358941661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ddf20982f454dd4a1c831e064b41ec6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c74dba-f4", "ovs_interfaceid": "d8c74dba-f494-4742-8a24-cc6f01cae599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:22:f6,bridge_name='br-int',has_traffic_filtering=True,id=d8c74dba-f494-4742-8a24-cc6f01cae599,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c74dba-f4') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_vif [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:22:f6,bridge_name='br-int',has_traffic_filtering=True,id=d8c74dba-f494-4742-8a24-cc6f01cae599,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c74dba-f4') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c74dba-f4, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc7f9935-ad18-43ec-b754-4e5bbdbbfb0e) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:26:49 user nova-compute[75255]: INFO os_vif [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:22:f6,bridge_name='br-int',has_traffic_filtering=True,id=d8c74dba-f494-4742-8a24-cc6f01cae599,network=Network(4cd8e8f6-e3f4-4d8b-a5e3-d3eb722ef5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c74dba-f4')
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPUtOJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:26:49 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e76a15a-8312-4c7c-97d6-6ab0bfed5e93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:26:49 user nova-compute[75255]: No targets found.
Nov 14 11:26:49 user nova-compute[75255]: iSNS:
Nov 14 11:26:49 user nova-compute[75255]: No targets found.
Nov 14 11:26:49 user nova-compute[75255]: STATIC:
Nov 14 11:26:49 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:26:49 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:26:49 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:26:49 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:26:49 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:26:49 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:26:49 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:26:49 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:26:49 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:26:49 user nova-compute[75255]: FIRMWARE:
Nov 14 11:26:49 user nova-compute[75255]: No targets found.
Nov 14 11:26:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:26:49 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:26:49 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a1d53a5-816c-48a1-8bc5-c23e08fb7c35', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c2bf44-c5d6-4657-82e3-fadb20e411ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e987dda-e907-47f7-9968-ac7e04d6d205]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:49 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:49 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:26:49 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:26:49 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:26:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a7370>, {}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Disconnecting from: [] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] <== disconnect_volume: return (72ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:26:49 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Deleting instance files /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1_del
Nov 14 11:26:49 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Deletion of /opt/stack/data/nova/instances/aa807cc9-5175-4b36-8210-7cef688b71c1_del complete
Nov 14 11:26:49 user nova-compute[75255]: INFO nova.compute.manager [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 11:26:49 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:26:49 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:26:50 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:26:50 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Took 0.81 seconds to deallocate network for instance.
Nov 14 11:26:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-a2c62575-57e6-4456-bb87-5bbe63c42602 req-9e3b3ebe-815b-416c-a7fd-ff6197e5cbfe service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-vif-deleted-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:50 user nova-compute[75255]: WARNING nova.volume.cinder [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Attachment e2001149-3439-41af-9109-06d1003d810b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e2001149-3439-41af-9109-06d1003d810b. (HTTP 404) (Request-ID: req-c5dbcf55-b60c-4bc8-8bbf-7d3bfb8e7810)
Nov 14 11:26:50 user nova-compute[75255]: INFO nova.compute.manager [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 11:26:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:51 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Deleted allocations for instance aa807cc9-5175-4b36-8210-7cef688b71c1
Nov 14 11:26:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-afe4cbd6-3af7-4415-973d-b7787b780e05 tempest-VolumesSnapshotTestJSON-610019682 tempest-VolumesSnapshotTestJSON-610019682-project-member] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-6e0dab52-302d-4319-a288-89c0b7a04005 req-a8cd79c5-67bd-4092-8524-391a6bd73e29 service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received event network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6e0dab52-302d-4319-a288-89c0b7a04005 req-a8cd79c5-67bd-4092-8524-391a6bd73e29 service nova] Acquiring lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6e0dab52-302d-4319-a288-89c0b7a04005 req-a8cd79c5-67bd-4092-8524-391a6bd73e29 service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6e0dab52-302d-4319-a288-89c0b7a04005 req-a8cd79c5-67bd-4092-8524-391a6bd73e29 service nova] Lock "aa807cc9-5175-4b36-8210-7cef688b71c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:26:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-6e0dab52-302d-4319-a288-89c0b7a04005 req-a8cd79c5-67bd-4092-8524-391a6bd73e29 service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] No waiting events found dispatching network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:26:51 user nova-compute[75255]: WARNING nova.compute.manager [req-6e0dab52-302d-4319-a288-89c0b7a04005 req-a8cd79c5-67bd-4092-8524-391a6bd73e29 service nova] [instance: aa807cc9-5175-4b36-8210-7cef688b71c1] Received unexpected event network-vif-plugged-d8c74dba-f494-4742-8a24-cc6f01cae599 for instance with vm_state deleted and task_state None.
Nov 14 11:26:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:26:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:27:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:27:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:27:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:27:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:27:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:32 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:27:44 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:45 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:27:45 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8314MB free_disk=24.94548797607422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance ae76487b-9360-43d4-b081-68186acc2565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:27:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Updating instance_info_cache with network_info: [{"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-2bb9fe90-561b-4cf2-a657-756594130121" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:27:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:52 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:27:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:27:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:27:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:27:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:27:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:27:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:27:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:27:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:27:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:27:59 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:27:59 user nova-compute[75255]: INFO nova.compute.claims [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Claim successful on node user
Nov 14 11:28:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-changed-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Refreshing instance network info cache due to event network-changed-3df945d4-067c-4ff3-812d-f020c97468f9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] Acquiring lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] Acquired lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.network.neutron [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Refreshing network info cache for port 3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:28:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.policy [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd57172d6d9ea4352a0de539b0f0ed256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf3d9268f65441895036512e1b5a98e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:28:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Creating image(s)
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "/opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "/opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'flavor' on Instance uuid d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.network.neutron [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updated VIF entry in instance network info cache for port 3df945d4-067c-4ff3-812d-f020c97468f9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG nova.network.neutron [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating instance_info_cache with network_info: [{"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d030ad06-fe0f-49aa-a368-61346094cd55 req-1c5909e5-2358-446b-9e12-8fdc73dab399 service nova] Releasing lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:00 user nova-compute[75255]: INFO nova.compute.manager [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Attaching volume 20038797-d04b-4707-9e16-cdafcf7a53f1 to /dev/vdb
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk 1073741824" returned: 0 in 0.058s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Successfully created port: 025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG os_brick.utils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66c147-1aa1-4ddb-87a6-c48931b964af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e2429-9163-436e-bfd9-49b054e7222a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b240a5-658e-4254-8606-ec4f9d534d45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f344091-5725-4c66-bb48-e4f7f439ff27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.201s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:28:01 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e12928-6a61-4b84-b512-27d063fff583]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG os_brick.utils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating existing volume attachment record: 3de794fc-e6ab-42f2-8e2f-fb72575c1bb7 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Cannot resize image /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Ensure instance console log exists: /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Successfully updated port: 025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquired lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-changed-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Refreshing instance network info cache due to event network-changed-025100a4-a2e8-44f9-8527-ffb21667e406. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] Acquiring lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:28:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updating instance_info_cache with network_info: [{"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Releasing lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Instance network_info: |[{"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] Acquired lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Refreshing network info cache for port 025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Start _get_guest_xml network_info=[{"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:28:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:28:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-936708891',display_name='tempest-TestServerVolumeAttachmentScenario-server-936708891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-936708891',id=38,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRPDADsP95mhbienZV5wgnu/NFjIlnaFo3OdaQRrtee/aXvG9SjQa4NUYbDHkudvKBUFLVSsGvfAnQLhwu3xHMNeDvzC0X5QZ2CCiepKqP6G1uwQlTCZ/mVX7J2Q6A2KA==',key_name='tempest-keypair-1300622259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf3d9268f65441895036512e1b5a98e',ramdisk_id='',reservation_id='r-kejniyp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-617126292',owner_user_name='tempest-TestServerVolumeAttachmentScenario-617126292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d57172d6d9ea4352a0de539b0f0ed256',uuid=b8825fce-bc47-40b6-818d-8dc4b4013a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Converting VIF {"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:33,bridge_name='br-int',has_traffic_filtering=True,id=025100a4-a2e8-44f9-8527-ffb21667e406,network=Network(919ddde7-d42a-412b-8b91-c52015bd2da9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025100a4-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'pci_devices' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:28:02 user nova-compute[75255]:   <uuid>b8825fce-bc47-40b6-818d-8dc4b4013a3e</uuid>
Nov 14 11:28:02 user nova-compute[75255]:   <name>instance-00000026</name>
Nov 14 11:28:02 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:28:02 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:28:02 user nova-compute[75255]:   <metadata>
Nov 14 11:28:02 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:28:02 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:28:02 user nova-compute[75255]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-936708891</nova:name>
Nov 14 11:28:02 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:28:02</nova:creationTime>
Nov 14 11:28:02 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:28:02 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:28:02 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:28:02 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:28:02 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:28:02 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:28:02 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:28:02 user nova-compute[75255]:       <nova:owner>
Nov 14 11:28:02 user nova-compute[75255]:         <nova:user uuid="d57172d6d9ea4352a0de539b0f0ed256">tempest-TestServerVolumeAttachmentScenario-617126292-project-member</nova:user>
Nov 14 11:28:02 user nova-compute[75255]:         <nova:project uuid="fdf3d9268f65441895036512e1b5a98e">tempest-TestServerVolumeAttachmentScenario-617126292</nova:project>
Nov 14 11:28:02 user nova-compute[75255]:       </nova:owner>
Nov 14 11:28:02 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:28:02 user nova-compute[75255]:       <nova:ports>
Nov 14 11:28:02 user nova-compute[75255]:         <nova:port uuid="025100a4-a2e8-44f9-8527-ffb21667e406">
Nov 14 11:28:02 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 11:28:02 user nova-compute[75255]:         </nova:port>
Nov 14 11:28:02 user nova-compute[75255]:       </nova:ports>
Nov 14 11:28:02 user nova-compute[75255]:     </nova:instance>
Nov 14 11:28:02 user nova-compute[75255]:   </metadata>
Nov 14 11:28:02 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:28:02 user nova-compute[75255]:     <system>
Nov 14 11:28:02 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:28:02 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:28:02 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:28:02 user nova-compute[75255]:       <entry name="serial">b8825fce-bc47-40b6-818d-8dc4b4013a3e</entry>
Nov 14 11:28:02 user nova-compute[75255]:       <entry name="uuid">b8825fce-bc47-40b6-818d-8dc4b4013a3e</entry>
Nov 14 11:28:02 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:28:02 user nova-compute[75255]:     </system>
Nov 14 11:28:02 user nova-compute[75255]:   </sysinfo>
Nov 14 11:28:02 user nova-compute[75255]:   <os>
Nov 14 11:28:02 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:28:02 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:28:02 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:28:02 user nova-compute[75255]:   </os>
Nov 14 11:28:02 user nova-compute[75255]:   <features>
Nov 14 11:28:02 user nova-compute[75255]:     <acpi/>
Nov 14 11:28:02 user nova-compute[75255]:     <apic/>
Nov 14 11:28:02 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:28:02 user nova-compute[75255]:   </features>
Nov 14 11:28:02 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:28:02 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:28:02 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:28:02 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:28:02 user nova-compute[75255]:   </clock>
Nov 14 11:28:02 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:28:02 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:28:02 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:28:02 user nova-compute[75255]:   </cpu>
Nov 14 11:28:02 user nova-compute[75255]:   <devices>
Nov 14 11:28:02 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:28:02 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:28:02 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk"/>
Nov 14 11:28:02 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:28:02 user nova-compute[75255]:     </disk>
Nov 14 11:28:02 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:28:02 user nova-compute[75255]:       <mac address="fa:16:3e:70:e4:33"/>
Nov 14 11:28:02 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:28:02 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:28:02 user nova-compute[75255]:       <target dev="tap025100a4-a2"/>
Nov 14 11:28:02 user nova-compute[75255]:     </interface>
Nov 14 11:28:02 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:28:02 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/console.log" append="off"/>
Nov 14 11:28:02 user nova-compute[75255]:     </serial>
Nov 14 11:28:02 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:28:02 user nova-compute[75255]:     <video>
Nov 14 11:28:02 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:28:02 user nova-compute[75255]:     </video>
Nov 14 11:28:02 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:28:02 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:28:02 user nova-compute[75255]:     </rng>
Nov 14 11:28:02 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:28:02 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:28:02 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:28:02 user nova-compute[75255]:     </memballoon>
Nov 14 11:28:02 user nova-compute[75255]:   </devices>
Nov 14 11:28:02 user nova-compute[75255]: </domain>
Nov 14 11:28:02 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-936708891',display_name='tempest-TestServerVolumeAttachmentScenario-server-936708891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-936708891',id=38,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRPDADsP95mhbienZV5wgnu/NFjIlnaFo3OdaQRrtee/aXvG9SjQa4NUYbDHkudvKBUFLVSsGvfAnQLhwu3xHMNeDvzC0X5QZ2CCiepKqP6G1uwQlTCZ/mVX7J2Q6A2KA==',key_name='tempest-keypair-1300622259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf3d9268f65441895036512e1b5a98e',ramdisk_id='',reservation_id='r-kejniyp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-617126292',owner_user_name='tempest-TestServerVolumeAttachmentScenario-617126292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d57172d6d9ea4352a0de539b0f0ed256',uuid=b8825fce-bc47-40b6-818d-8dc4b4013a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Converting VIF {"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:33,bridge_name='br-int',has_traffic_filtering=True,id=025100a4-a2e8-44f9-8527-ffb21667e406,network=Network(919ddde7-d42a-412b-8b91-c52015bd2da9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025100a4-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG os_vif [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:33,bridge_name='br-int',has_traffic_filtering=True,id=025100a4-a2e8-44f9-8527-ffb21667e406,network=Network(919ddde7-d42a-412b-8b91-c52015bd2da9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025100a4-a2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4a7cdf5-93fc-5497-9f75-886e280ccf88', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap025100a4-a2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap025100a4-a2, col_values=(('qos', UUID('07814b60-e880-4377-8aa3-09d6727bea31')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap025100a4-a2, col_values=(('external_ids', {'iface-id': '025100a4-a2e8-44f9-8527-ffb21667e406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:e4:33', 'vm-uuid': 'b8825fce-bc47-40b6-818d-8dc4b4013a3e'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:02 user nova-compute[75255]: INFO os_vif [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:33,bridge_name='br-int',has_traffic_filtering=True,id=025100a4-a2e8-44f9-8527-ffb21667e406,network=Network(919ddde7-d42a-412b-8b91-c52015bd2da9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025100a4-a2')
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No VIF found with MAC fa:16:3e:70:e4:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updated VIF entry in instance network info cache for port 025100a4-a2e8-44f9-8527-ffb21667e406. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updating instance_info_cache with network_info: [{"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:28:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-66597a79-b116-4b02-a1b2-503d8ea25ff5 req-58028b16-faa0-4977-b395-c689d8e439c6 service nova] Releasing lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-115d51a6-4e50-4aba-8322-232a86a5b212 req-e1b54379-18c3-4785-b546-62b8c4d3a4d3 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-115d51a6-4e50-4aba-8322-232a86a5b212 req-e1b54379-18c3-4785-b546-62b8c4d3a4d3 service nova] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-115d51a6-4e50-4aba-8322-232a86a5b212 req-e1b54379-18c3-4785-b546-62b8c4d3a4d3 service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-115d51a6-4e50-4aba-8322-232a86a5b212 req-e1b54379-18c3-4785-b546-62b8c4d3a4d3 service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-115d51a6-4e50-4aba-8322-232a86a5b212 req-e1b54379-18c3-4785-b546-62b8c4d3a4d3 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] No waiting events found dispatching network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:28:03 user nova-compute[75255]: WARNING nova.compute.manager [req-115d51a6-4e50-4aba-8322-232a86a5b212 req-e1b54379-18c3-4785-b546-62b8c4d3a4d3 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received unexpected event network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 for instance with vm_state building and task_state spawning.
Nov 14 11:28:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:04 user nova-compute[75255]: INFO nova.compute.manager [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Unshelving
Nov 14 11:28:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:04 user nova-compute[75255]: INFO nova.virt.block_device [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Booting with volume ab6a3a66-526d-4c87-8c51-7994a8b7ca61 at /dev/vdc
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.utils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a0883-540a-435d-9bd7-4628abdf3f7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f9a6d-badb-492a-a56c-8bfaad228134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf1d981-6afd-4702-aabc-341099d4a661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9995e5-6b29-4996-a3e3-558f9f5bbc00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:28:05 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87defa7-26d9-4002-a13c-b8b5dba1aafb]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.utils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating existing volume attachment record: 0362407e-ae1b-4b61-b889-cddfc3ade591 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RicAOwBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:28:05 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:28:05 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:28:05 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[42704dca-cb96-40dc-8071-c0498e64e473]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:28:05 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abf4f2c-0bef-4805-852d-bd69e7afaad6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1] added
Nov 14 11:28:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51658f3f-5be2-4643-beae-65a0b27a4e04]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573c062-b78b-41c2-95e0-aa6fbf60eeff]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RicAOwBp {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RicAOwBp" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf555fdb-f954-46f8-b8f0-a8c355dbafba]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RicAOwBp'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-e24db430-27f4-4b74-9137-94c055d0a3cc req-65bc9fd4-7fde-4ce9-9b21-489115145d39 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e24db430-27f4-4b74-9137-94c055d0a3cc req-65bc9fd4-7fde-4ce9-9b21-489115145d39 service nova] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e24db430-27f4-4b74-9137-94c055d0a3cc req-65bc9fd4-7fde-4ce9-9b21-489115145d39 service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e24db430-27f4-4b74-9137-94c055d0a3cc req-65bc9fd4-7fde-4ce9-9b21-489115145d39 service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-e24db430-27f4-4b74-9137-94c055d0a3cc req-65bc9fd4-7fde-4ce9-9b21-489115145d39 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] No waiting events found dispatching network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:28:05 user nova-compute[75255]: WARNING nova.compute.manager [req-e24db430-27f4-4b74-9137-94c055d0a3cc req-65bc9fd4-7fde-4ce9-9b21-489115145d39 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received unexpected event network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 for instance with vm_state building and task_state spawning.
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:28:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Instance spawned successfully.
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c116de52-2659-4f9d-b109-34b0a21d8ba0]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aafe66c-bcc1-476d-bb2a-81da2072eb0f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: INFO nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 14 11:28:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad037061-64c5-4a0b-a70c-108145c5b0cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260]
Nov 14 11:28:05 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260] successful.
Nov 14 11:28:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f03f450-d6ae-4855-99cd-cb4b8f19a39d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea8d70-b2cf-44b4-add1-2052bfcd0607]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:05 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:05 user nova-compute[75255]: INFO nova.compute.manager [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Took 6.19 seconds to build instance.
Nov 14 11:28:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa07af1a-1859-4e7a-b251-c0a6fcdbeed2]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:28:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RicAOwBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:28:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8920d248-f670-47bd-b6fe-97ea163500b2 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.528s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23630653364633736', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630653364633736', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'flavor' on Instance uuid d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:28:07 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:28:07 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:28:07 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:28:07 user nova-compute[75255]:   <serial>20038797-d04b-4707-9e16-cdafcf7a53f1</serial>
Nov 14 11:28:07 user nova-compute[75255]: </disk>
Nov 14 11:28:07 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No VIF found with MAC fa:16:3e:c2:97:b1, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:28:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0e659589-e649-46e0-bb51-a4da6e223dad tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.626s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'pci_requests' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:10 user nova-compute[75255]: INFO nova.compute.manager [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Detaching volume 20038797-d04b-4707-9e16-cdafcf7a53f1
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'numa_topology' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:28:10 user nova-compute[75255]: INFO nova.compute.claims [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Claim successful on node user
Nov 14 11:28:10 user nova-compute[75255]: INFO nova.virt.block_device [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Attempting to driver detach volume 20038797-d04b-4707-9e16-cdafcf7a53f1 from mountpoint /dev/vdb
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Attempting to detach device vdb from instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:28:10 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:28:10 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:28:10 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:28:10 user nova-compute[75255]:   <serial>20038797-d04b-4707-9e16-cdafcf7a53f1</serial>
Nov 14 11:28:10 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:28:10 user nova-compute[75255]: </disk>
Nov 14 11:28:10 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:28:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully detached device vdb from instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a from the persistent domain config.
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:28:10 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:28:10 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:28:10 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:28:10 user nova-compute[75255]:   <serial>20038797-d04b-4707-9e16-cdafcf7a53f1</serial>
Nov 14 11:28:10 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:28:10 user nova-compute[75255]: </disk>
Nov 14 11:28:10 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:28:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:10 user nova-compute[75255]: INFO nova.network.neutron [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing instance network info cache due to event network-changed-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:28:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Creating image(s)
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.network.neutron [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Refreshing network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG nova.objects.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<7976be6c-afb4-4ddf-ac33-ddbd8a23265e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "3f9a071775ce85ca263461039288d821a0a7ff95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "3f9a071775ce85ca263461039288d821a0a7ff95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG nova.virt.images [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] 64436a2e-5afb-47b3-b3a1-99de9dca0250 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.part /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updated VIF entry in instance network info cache for port be93b8c3-8ade-4f96-b9b5-8da5cac2cd49. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3195b9a9-fb8a-4771-9ee0-514b2dde3f14 req-6ce6913f-5f8e-4d9e-97c7-e8e8b6887c24 service nova] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.part /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.converted" returned: 0 in 0.612s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "3f9a071775ce85ca263461039288d821a0a7ff95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.044s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95 --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "3f9a071775ce85ca263461039288d821a0a7ff95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "3f9a071775ce85ca263461039288d821a0a7ff95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95 --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95,backing_fmt=raw /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95,backing_fmt=raw /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk 1073741824" returned: 0 in 0.049s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "3f9a071775ce85ca263461039288d821a0a7ff95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95 --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'migration_context' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG nova.objects.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<7976be6c-afb4-4ddf-ac33-ddbd8a23265e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:28:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Rebasing disk image.
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 -F raw /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 -F raw /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk" returned: 0 in 2.107s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Ensure instance console log exists: /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Start _get_guest_xml network_info=[{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='f9894a3e6051f334860e6e9f3ee56dd4',container_format='bare',created_at=2023-11-14T11:26:13Z,direct_url=<?>,disk_format='qcow2',id=64436a2e-5afb-47b3-b3a1-99de9dca0250,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1984960086-shelved',owner='539e7facdc2a4ce081fa5eff222d0193',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T11:26:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '0362407e-ae1b-4b61-b889-cddfc3ade591', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTvgmSGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '7976be6c-afb4-4ddf-ac33-ddbd8a23265e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab6a3a66-526d-4c87-8c51-7994a8b7ca61', 'serial': 'ab6a3a66-526d-4c87-8c51-7994a8b7ca61'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:28:16 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:28:16 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f9894a3e6051f334860e6e9f3ee56dd4',container_format='bare',created_at=2023-11-14T11:26:13Z,direct_url=<?>,disk_format='qcow2',id=64436a2e-5afb-47b3-b3a1-99de9dca0250,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1984960086-shelved',owner='539e7facdc2a4ce081fa5eff222d0193',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T11:26:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.objects.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<7976be6c-afb4-4ddf-ac33-ddbd8a23265e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTvgmSGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:28:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:28:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:28:16 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c4b315-33e7-4b55-9aa4-3ec444a72d90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:28:16 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0745a56c-ac7f-4fc8-a9f3-f76d308845fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61] added
Nov 14 11:28:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a217a2-076c-4668-b6ec-5adf4867f603]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fccd94f-6e1c-49f2-a22d-d6fd308066c2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTvgmSGs {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTvgmSGs" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6fd7b5-5731-44fa-97ab-2c93a620ad83]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bTvgmSGs'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51063f3f-e684-41f8-b56a-2b7a50a8c465]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b8a35-944e-48b7-ae36-0346760c9232]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2936bb8d-ca6d-4cdd-a582-c4942cc09b50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260]
Nov 14 11:28:17 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260] successful.
Nov 14 11:28:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5ee2e6-5638-45dc-b89b-12d0f8f7db53]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5f24eb-9c9c-4a91-b808-195c2d0595b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:28:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c441e8c-8208-4cc6-8a49-81a07f6162ff]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTvgmSGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:28:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23332626463623235', 'path': '/dev/sde'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332626463623235', 'path': '/dev/sde'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984960086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984960086',id=34,image_ref='64436a2e-5afb-47b3-b3a1-99de9dca0250',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1100144298',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-90adzxhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member',shelved_at='2023-11-14T11:26:17.470147',shelved_host='user',shelved_image_id='64436a2e-5afb-47b3-b3a1-99de9dca0250'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:28:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=7976be6c-afb4-4ddf-ac33-ddbd8a23265e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'pci_devices' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.objects.base [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<7976be6c-afb4-4ddf-ac33-ddbd8a23265e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:28:18 user nova-compute[75255]:   <uuid>7976be6c-afb4-4ddf-ac33-ddbd8a23265e</uuid>
Nov 14 11:28:18 user nova-compute[75255]:   <name>instance-00000022</name>
Nov 14 11:28:18 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:28:18 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:28:18 user nova-compute[75255]:   <metadata>
Nov 14 11:28:18 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:28:18 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:28:18 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1984960086</nova:name>
Nov 14 11:28:18 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:28:16</nova:creationTime>
Nov 14 11:28:18 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:28:18 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:28:18 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:28:18 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:28:18 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:28:18 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:28:18 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:28:18 user nova-compute[75255]:       <nova:owner>
Nov 14 11:28:18 user nova-compute[75255]:         <nova:user uuid="7b4b049ae1654b4495e42b8ec2cb11f9">tempest-AttachVolumeShelveTestJSON-479009518-project-member</nova:user>
Nov 14 11:28:18 user nova-compute[75255]:         <nova:project uuid="539e7facdc2a4ce081fa5eff222d0193">tempest-AttachVolumeShelveTestJSON-479009518</nova:project>
Nov 14 11:28:18 user nova-compute[75255]:       </nova:owner>
Nov 14 11:28:18 user nova-compute[75255]:       <nova:root type="image" uuid="64436a2e-5afb-47b3-b3a1-99de9dca0250"/>
Nov 14 11:28:18 user nova-compute[75255]:       <nova:ports>
Nov 14 11:28:18 user nova-compute[75255]:         <nova:port uuid="be93b8c3-8ade-4f96-b9b5-8da5cac2cd49">
Nov 14 11:28:18 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 11:28:18 user nova-compute[75255]:         </nova:port>
Nov 14 11:28:18 user nova-compute[75255]:       </nova:ports>
Nov 14 11:28:18 user nova-compute[75255]:     </nova:instance>
Nov 14 11:28:18 user nova-compute[75255]:   </metadata>
Nov 14 11:28:18 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:28:18 user nova-compute[75255]:     <system>
Nov 14 11:28:18 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:28:18 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:28:18 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:28:18 user nova-compute[75255]:       <entry name="serial">7976be6c-afb4-4ddf-ac33-ddbd8a23265e</entry>
Nov 14 11:28:18 user nova-compute[75255]:       <entry name="uuid">7976be6c-afb4-4ddf-ac33-ddbd8a23265e</entry>
Nov 14 11:28:18 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:28:18 user nova-compute[75255]:     </system>
Nov 14 11:28:18 user nova-compute[75255]:   </sysinfo>
Nov 14 11:28:18 user nova-compute[75255]:   <os>
Nov 14 11:28:18 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:28:18 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:28:18 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:28:18 user nova-compute[75255]:   </os>
Nov 14 11:28:18 user nova-compute[75255]:   <features>
Nov 14 11:28:18 user nova-compute[75255]:     <acpi/>
Nov 14 11:28:18 user nova-compute[75255]:     <apic/>
Nov 14 11:28:18 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:28:18 user nova-compute[75255]:   </features>
Nov 14 11:28:18 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:28:18 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:28:18 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:28:18 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:28:18 user nova-compute[75255]:   </clock>
Nov 14 11:28:18 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:28:18 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:28:18 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:28:18 user nova-compute[75255]:   </cpu>
Nov 14 11:28:18 user nova-compute[75255]:   <devices>
Nov 14 11:28:18 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:28:18 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:28:18 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk"/>
Nov 14 11:28:18 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:28:18 user nova-compute[75255]:     </disk>
Nov 14 11:28:18 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:28:18 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:28:18 user nova-compute[75255]:       <source dev="/dev/sde"/>
Nov 14 11:28:18 user nova-compute[75255]:       <target dev="vdc" bus="virtio"/>
Nov 14 11:28:18 user nova-compute[75255]:       <serial>ab6a3a66-526d-4c87-8c51-7994a8b7ca61</serial>
Nov 14 11:28:18 user nova-compute[75255]:     </disk>
Nov 14 11:28:18 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:28:18 user nova-compute[75255]:       <mac address="fa:16:3e:2f:00:7c"/>
Nov 14 11:28:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:28:18 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:28:18 user nova-compute[75255]:       <target dev="tapbe93b8c3-8a"/>
Nov 14 11:28:18 user nova-compute[75255]:     </interface>
Nov 14 11:28:18 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:28:18 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/console.log" append="off"/>
Nov 14 11:28:18 user nova-compute[75255]:     </serial>
Nov 14 11:28:18 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:28:18 user nova-compute[75255]:     <video>
Nov 14 11:28:18 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:28:18 user nova-compute[75255]:     </video>
Nov 14 11:28:18 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:28:18 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:28:18 user nova-compute[75255]:     </rng>
Nov 14 11:28:18 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:28:18 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:28:18 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:28:18 user nova-compute[75255]:     </memballoon>
Nov 14 11:28:18 user nova-compute[75255]:   </devices>
Nov 14 11:28:18 user nova-compute[75255]: </domain>
Nov 14 11:28:18 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984960086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984960086',id=34,image_ref='64436a2e-5afb-47b3-b3a1-99de9dca0250',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1100144298',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-90adzxhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member',shelved_at='2023-11-14T11:26:17.470147',shelved_host='user',shelved_image_id='64436a2e-5afb-47b3-b3a1-99de9dca0250'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:28:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=7976be6c-afb4-4ddf-ac33-ddbd8a23265e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG os_vif [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46e8c5ec-e649-5e26-903e-fdaab944acc8', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe93b8c3-8a, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe93b8c3-8a, col_values=(('qos', UUID('1baafeec-2c5e-4ee2-9088-7050753b6fe0')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe93b8c3-8a, col_values=(('external_ids', {'iface-id': 'be93b8c3-8ade-4f96-b9b5-8da5cac2cd49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:00:7c', 'vm-uuid': '7976be6c-afb4-4ddf-ac33-ddbd8a23265e'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:18 user nova-compute[75255]: INFO os_vif [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a')
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:28:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No VIF found with MAC fa:16:3e:2f:00:7c, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-46acff08-fdc7-4440-972d-042ada0b194f req-1a379e5f-085a-4f74-bae5-a8093dd1ac2a service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-46acff08-fdc7-4440-972d-042ada0b194f req-1a379e5f-085a-4f74-bae5-a8093dd1ac2a service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-46acff08-fdc7-4440-972d-042ada0b194f req-1a379e5f-085a-4f74-bae5-a8093dd1ac2a service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-46acff08-fdc7-4440-972d-042ada0b194f req-1a379e5f-085a-4f74-bae5-a8093dd1ac2a service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-46acff08-fdc7-4440-972d-042ada0b194f req-1a379e5f-085a-4f74-bae5-a8093dd1ac2a service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:28:19 user nova-compute[75255]: WARNING nova.compute.manager [req-46acff08-fdc7-4440-972d-042ada0b194f req-1a379e5f-085a-4f74-bae5-a8093dd1ac2a service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received unexpected event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 11:28:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:28:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:28:21 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance spawned successfully.
Nov 14 11:28:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-6a5825d3-8c5b-49a7-af26-39a8517fbf7e req-8ee40678-8e3b-491b-9832-540ce9e3c3f4 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6a5825d3-8c5b-49a7-af26-39a8517fbf7e req-8ee40678-8e3b-491b-9832-540ce9e3c3f4 service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6a5825d3-8c5b-49a7-af26-39a8517fbf7e req-8ee40678-8e3b-491b-9832-540ce9e3c3f4 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6a5825d3-8c5b-49a7-af26-39a8517fbf7e req-8ee40678-8e3b-491b-9832-540ce9e3c3f4 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:21 user nova-compute[75255]: DEBUG nova.compute.manager [req-6a5825d3-8c5b-49a7-af26-39a8517fbf7e req-8ee40678-8e3b-491b-9832-540ce9e3c3f4 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:28:21 user nova-compute[75255]: WARNING nova.compute.manager [req-6a5825d3-8c5b-49a7-af26-39a8517fbf7e req-8ee40678-8e3b-491b-9832-540ce9e3c3f4 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received unexpected event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 11:28:21 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:28:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5bd491b3-1b63-431d-a6de-f06809d42387 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.367s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:30 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a is timed out.
Nov 14 11:28:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully detached device vdb from instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a from the live domain config.
Nov 14 11:28:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RicAOwBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:28:30 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b71be-c4c0-4560-97cc-1cac57e48ea8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:28:30 user nova-compute[75255]: No targets found.
Nov 14 11:28:30 user nova-compute[75255]: iSNS:
Nov 14 11:28:30 user nova-compute[75255]: No targets found.
Nov 14 11:28:30 user nova-compute[75255]: STATIC:
Nov 14 11:28:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:28:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:28:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61
Nov 14 11:28:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:28:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1
Nov 14 11:28:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:30 user nova-compute[75255]: FIRMWARE:
Nov 14 11:28:30 user nova-compute[75255]: No targets found.
Nov 14 11:28:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:28:30 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:28:30 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9d0dc-4aa6-466b-8a37-65beb5624d30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddf0d50-aca8-4dde-8029-c9492ab06eba]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:28:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 (non-flash)
Nov 14 11:28:30 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:28:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3284725f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dcd2af-07e4-4cd0-96b2-c9e1a2dcb4e6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[467fac55-ed34-4723-a101-a803cd5cb282]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb463a6-a906-4f9c-ba72-9284d7ed7be7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc481bc-f6a0-42cc-befe-da6bd6b30db6]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7249eaa5-6345-486c-8a1e-3a72724f8c34]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[61404cd5-97ef-452c-8d40-670a337f98c2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260]
Nov 14 11:28:31 user nova-compute[75255]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1, portal: 172.16.0.220,3260] successful.
Nov 14 11:28:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20038797-d04b-4707-9e16-cdafcf7a53f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf7df5-2f46-4633-a630-f51b2f805f4a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] <== disconnect_volume: return (301ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:28:31 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'flavor' on Instance uuid d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f1f8e9f8-86d1-4889-8ee9-a1309150ef19 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:32 user nova-compute[75255]: INFO nova.compute.manager [None req-ab96e10b-ea34-4edc-9fe2-97fc7c11cd36 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Get console output
Nov 14 11:28:32 user nova-compute[75255]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 11:28:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "ae76487b-9360-43d4-b081-68186acc2565" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:35 user nova-compute[75255]: INFO nova.compute.manager [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Terminating instance
Nov 14 11:28:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-c3872670-2771-4a25-956c-3d75feab24ac req-917bc92b-6e63-48d1-bafb-3b9d8fba0d83 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c3872670-2771-4a25-956c-3d75feab24ac req-917bc92b-6e63-48d1-bafb-3b9d8fba0d83 service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c3872670-2771-4a25-956c-3d75feab24ac req-917bc92b-6e63-48d1-bafb-3b9d8fba0d83 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c3872670-2771-4a25-956c-3d75feab24ac req-917bc92b-6e63-48d1-bafb-3b9d8fba0d83 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-c3872670-2771-4a25-956c-3d75feab24ac req-917bc92b-6e63-48d1-bafb-3b9d8fba0d83 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:28:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-c3872670-2771-4a25-956c-3d75feab24ac req-917bc92b-6e63-48d1-bafb-3b9d8fba0d83 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-unplugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Instance destroyed successfully.
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.objects.instance [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'resources' on Instance uuid ae76487b-9360-43d4-b081-68186acc2565 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369322017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369322017',id=33,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:25:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-1j5wk6bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:26:49Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=ae76487b-9360-43d4-b081-68186acc2565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "address": "fa:16:3e:e4:2e:93", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962caa2-9c", "ovs_interfaceid": "5962caa2-9c61-4cf6-bd36-0b9fc6153aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_vif [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5962caa2-9c, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a9ffa27-222d-4e31-84c0-6fe1d92f4445) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:36 user nova-compute[75255]: INFO os_vif [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:2e:93,bridge_name='br-int',has_traffic_filtering=True,id=5962caa2-9c61-4cf6-bd36-0b9fc6153aed,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962caa2-9c')
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPvybpSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:28:36 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da0db7d-506e-4711-a488-3d0cf3c35f4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:28:36 user nova-compute[75255]: No targets found.
Nov 14 11:28:36 user nova-compute[75255]: iSNS:
Nov 14 11:28:36 user nova-compute[75255]: No targets found.
Nov 14 11:28:36 user nova-compute[75255]: STATIC:
Nov 14 11:28:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:28:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1
Nov 14 11:28:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61
Nov 14 11:28:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:28:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:28:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:28:36 user nova-compute[75255]: FIRMWARE:
Nov 14 11:28:36 user nova-compute[75255]: No targets found.
Nov 14 11:28:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:28:36 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:28:36 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9085fda1-8280-4eb5-9bdb-b19b32babc98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[50368c75-d075-4fe4-adb0-e09a9c577047]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:36 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:36 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:36 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:28:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:28:36 user nova-compute[75255]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 (non-flash)
Nov 14 11:28:36 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:28:36 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:28:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff328472950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1'): ({'sdf'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Removing single pathed devices sdf {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6701a6-450e-4597-b95d-aefb50c8c5b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed58104-64b4-4caf-a04e-be1cac5b3249]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flushing IO for device /dev/sdf {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2b72d3-af30-400a-818f-187cb822b131]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835e8f3-1d34-42d3-83e7-c9f96982ad76]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] SCSI volumes sdf have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb2f79a-54eb-46d8-ac58-6d1fb01d1aeb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc546d-dd3c-4987-b555-c1a0379b54a7]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260]
Nov 14 11:28:36 user nova-compute[75255]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1, portal: 172.16.0.220,3260] successful.
Nov 14 11:28:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac19eea3-84bb-4271-bec4-e8d4b409ffd1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82e5507-fa55-4009-b3ea-2abb09d8e525]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== disconnect_volume: return (328ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:28:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Deleting instance files /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565_del
Nov 14 11:28:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Deletion of /opt/stack/data/nova/instances/ae76487b-9360-43d4-b081-68186acc2565_del complete
Nov 14 11:28:36 user nova-compute[75255]: INFO nova.compute.manager [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 11:28:36 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:28:36 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:28:37 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:28:37 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: ae76487b-9360-43d4-b081-68186acc2565] Took 0.39 seconds to deallocate network for instance.
Nov 14 11:28:37 user nova-compute[75255]: INFO nova.compute.manager [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: ae76487b-9360-43d4-b081-68186acc2565] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 11:28:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-30123370-2815-4c8f-830f-84821e611e1b req-c49cb75b-8ac6-4fe5-9004-54cd814a65f6 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-30123370-2815-4c8f-830f-84821e611e1b req-c49cb75b-8ac6-4fe5-9004-54cd814a65f6 service nova] Acquiring lock "ae76487b-9360-43d4-b081-68186acc2565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-30123370-2815-4c8f-830f-84821e611e1b req-c49cb75b-8ac6-4fe5-9004-54cd814a65f6 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-30123370-2815-4c8f-830f-84821e611e1b req-c49cb75b-8ac6-4fe5-9004-54cd814a65f6 service nova] Lock "ae76487b-9360-43d4-b081-68186acc2565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-30123370-2815-4c8f-830f-84821e611e1b req-c49cb75b-8ac6-4fe5-9004-54cd814a65f6 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] No waiting events found dispatching network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:28:37 user nova-compute[75255]: WARNING nova.compute.manager [req-30123370-2815-4c8f-830f-84821e611e1b req-c49cb75b-8ac6-4fe5-9004-54cd814a65f6 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received unexpected event network-vif-plugged-5962caa2-9c61-4cf6-bd36-0b9fc6153aed for instance with vm_state deleted and task_state None.
Nov 14 11:28:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-30123370-2815-4c8f-830f-84821e611e1b req-c49cb75b-8ac6-4fe5-9004-54cd814a65f6 service nova] [instance: ae76487b-9360-43d4-b081-68186acc2565] Received event network-vif-deleted-5962caa2-9c61-4cf6-bd36-0b9fc6153aed {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:28:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:28:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:28:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:38 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Deleted allocations for instance ae76487b-9360-43d4-b081-68186acc2565
Nov 14 11:28:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-00e3383f-1e2f-41fa-b27d-0baa96472675 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "ae76487b-9360-43d4-b081-68186acc2565" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.722s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:28:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:28:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:28:47 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:28:47 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:28:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8120MB free_disk=24.888290405273438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:28:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:28:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 2bb9fe90-561b-4cf2-a657-756594130121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance b8825fce-bc47-40b6-818d-8dc4b4013a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:28:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [{"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-eaf8bf74-7ef8-4eca-8098-0a675ca188cb" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:50 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:28:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:28:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:28:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:28:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:28:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:28:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:29:02 user nova-compute[75255]: INFO nova.compute.manager [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] instance snapshotting
Nov 14 11:29:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Beginning live snapshot process
Nov 14 11:29:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json -f qcow2 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.166s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq_hqb9dp/c231782ccdae4175b55564b6490ca6ad.delta 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq_hqb9dp/c231782ccdae4175b55564b6490ca6ad.delta 1073741824" returned: 0 in 0.056s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 11:29:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:29:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75255) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 11:29:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 11:29:04 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:29:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq_hqb9dp/c231782ccdae4175b55564b6490ca6ad.delta /opt/stack/data/nova/instances/snapshots/tmpq_hqb9dp/c231782ccdae4175b55564b6490ca6ad {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq_hqb9dp/c231782ccdae4175b55564b6490ca6ad.delta /opt/stack/data/nova/instances/snapshots/tmpq_hqb9dp/c231782ccdae4175b55564b6490ca6ad" returned: 0 in 0.597s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Snapshot extracted, beginning image upload
Nov 14 11:29:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:07 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Snapshot image upload complete
Nov 14 11:29:07 user nova-compute[75255]: INFO nova.compute.manager [None req-d92d088f-c518-4573-b3de-438461469478 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Took 5.22 seconds to snapshot the instance on the hypervisor.
Nov 14 11:29:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:29:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:29:10 user nova-compute[75255]: INFO nova.compute.claims [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Claim successful on node user
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:29:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.policy [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4e5f5081c1b4691a79b2839bfc8c124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9282a36a740403f8a65ede3b9405d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:29:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Creating image(s)
Nov 14 11:29:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "/opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "/opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "/opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e2012ce6e57e9c96668affdda3601d1f92b55d9f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e2012ce6e57e9c96668affdda3601d1f92b55d9f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Successfully created port: fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:29:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:11 user nova-compute[75255]: DEBUG nova.virt.images [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] 66995d93-4111-4a4d-94bf-e15b4f3a2e58 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:29:11 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:29:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.part /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.part /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.converted" returned: 0 in 0.393s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Successfully updated port: fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-changed-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Refreshing instance network info cache due to event network-changed-fe5a2cb3-7102-4441-8906-cba971adb014. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] Acquiring lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] Acquired lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Refreshing network info cache for port fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e2012ce6e57e9c96668affdda3601d1f92b55d9f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.714s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.neutron [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-42e1b041-625d-4f09-8227-085588173501 req-318027b7-e7cd-4dde-86ad-dea75f6eba6e service nova] Releasing lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquired lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e2012ce6e57e9c96668affdda3601d1f92b55d9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e2012ce6e57e9c96668affdda3601d1f92b55d9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f,backing_fmt=raw /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f,backing_fmt=raw /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk 1073741824" returned: 0 in 0.048s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e2012ce6e57e9c96668affdda3601d1f92b55d9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updating instance_info_cache with network_info: [{"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Releasing lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Instance network_info: |[{"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Ensure instance console log exists: /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Start _get_guest_xml network_info=[{"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cedf80aa6084127ee87cc282be7959d4',container_format='bare',created_at=2023-11-14T11:29:02Z,direct_url=<?>,disk_format='qcow2',id=66995d93-4111-4a4d-94bf-e15b4f3a2e58,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1897154934',owner='c9282a36a740403f8a65ede3b9405d22',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T11:29:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '66995d93-4111-4a4d-94bf-e15b4f3a2e58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:29:12 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:29:12 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cedf80aa6084127ee87cc282be7959d4',container_format='bare',created_at=2023-11-14T11:29:02Z,direct_url=<?>,disk_format='qcow2',id=66995d93-4111-4a4d-94bf-e15b4f3a2e58,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1897154934',owner='c9282a36a740403f8a65ede3b9405d22',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T11:29:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-531815042',display_name='tempest-TestStampPattern-server-531815042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-531815042',id=39,image_ref='66995d93-4111-4a4d-94bf-e15b4f3a2e58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+K+knKpNyZnoq/fwoIWr7QItDZQ5aLjEM7xC051cHvbV98q9oTME1VV23X8TxAqVI6fYWttj3e2KZ5Vhxbye8R2SGnCj7WIl6zRE+W17wWjn1nejVZq2nLaP4MQnIrw==',key_name='tempest-TestStampPattern-1486227609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9282a36a740403f8a65ede3b9405d22',ramdisk_id='',reservation_id='r-53yuxceg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a',image_min_disk='1',image_min_ram='0',image_owner_id='c9282a36a740403f8a65ede3b9405d22',image_owner_project_name='tempest-TestStampPattern-761473602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-761473602-project-member',image_user_id='a4e5f5081c1b4691a79b2839bfc8c124',network_allocated='True',owner_project_name='tempest-TestStampPattern-761473602',owner_user_name='tempest-TestStampPattern-761473602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:29:10Z,user_data=None,user_id='a4e5f5081c1b4691a79b2839bfc8c124',uuid=e574025a-2522-4796-8cdb-336bf8e14cd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converting VIF {"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:a9,bridge_name='br-int',has_traffic_filtering=True,id=fe5a2cb3-7102-4441-8906-cba971adb014,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5a2cb3-71') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'pci_devices' on Instance uuid e574025a-2522-4796-8cdb-336bf8e14cd3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:29:12 user nova-compute[75255]:   <uuid>e574025a-2522-4796-8cdb-336bf8e14cd3</uuid>
Nov 14 11:29:12 user nova-compute[75255]:   <name>instance-00000027</name>
Nov 14 11:29:12 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:29:12 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:29:12 user nova-compute[75255]:   <metadata>
Nov 14 11:29:12 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:29:12 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:29:12 user nova-compute[75255]:       <nova:name>tempest-TestStampPattern-server-531815042</nova:name>
Nov 14 11:29:12 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:29:12</nova:creationTime>
Nov 14 11:29:12 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:29:12 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:29:12 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:29:12 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:29:12 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:29:12 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:29:12 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:29:12 user nova-compute[75255]:       <nova:owner>
Nov 14 11:29:12 user nova-compute[75255]:         <nova:user uuid="a4e5f5081c1b4691a79b2839bfc8c124">tempest-TestStampPattern-761473602-project-member</nova:user>
Nov 14 11:29:12 user nova-compute[75255]:         <nova:project uuid="c9282a36a740403f8a65ede3b9405d22">tempest-TestStampPattern-761473602</nova:project>
Nov 14 11:29:12 user nova-compute[75255]:       </nova:owner>
Nov 14 11:29:12 user nova-compute[75255]:       <nova:root type="image" uuid="66995d93-4111-4a4d-94bf-e15b4f3a2e58"/>
Nov 14 11:29:12 user nova-compute[75255]:       <nova:ports>
Nov 14 11:29:12 user nova-compute[75255]:         <nova:port uuid="fe5a2cb3-7102-4441-8906-cba971adb014">
Nov 14 11:29:12 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 11:29:12 user nova-compute[75255]:         </nova:port>
Nov 14 11:29:12 user nova-compute[75255]:       </nova:ports>
Nov 14 11:29:12 user nova-compute[75255]:     </nova:instance>
Nov 14 11:29:12 user nova-compute[75255]:   </metadata>
Nov 14 11:29:12 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:29:12 user nova-compute[75255]:     <system>
Nov 14 11:29:12 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:29:12 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:29:12 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:29:12 user nova-compute[75255]:       <entry name="serial">e574025a-2522-4796-8cdb-336bf8e14cd3</entry>
Nov 14 11:29:12 user nova-compute[75255]:       <entry name="uuid">e574025a-2522-4796-8cdb-336bf8e14cd3</entry>
Nov 14 11:29:12 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:29:12 user nova-compute[75255]:     </system>
Nov 14 11:29:12 user nova-compute[75255]:   </sysinfo>
Nov 14 11:29:12 user nova-compute[75255]:   <os>
Nov 14 11:29:12 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:29:12 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:29:12 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:29:12 user nova-compute[75255]:   </os>
Nov 14 11:29:12 user nova-compute[75255]:   <features>
Nov 14 11:29:12 user nova-compute[75255]:     <acpi/>
Nov 14 11:29:12 user nova-compute[75255]:     <apic/>
Nov 14 11:29:12 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:29:12 user nova-compute[75255]:   </features>
Nov 14 11:29:12 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:29:12 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:29:12 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:29:12 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:29:12 user nova-compute[75255]:   </clock>
Nov 14 11:29:12 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:29:12 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:29:12 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:29:12 user nova-compute[75255]:   </cpu>
Nov 14 11:29:12 user nova-compute[75255]:   <devices>
Nov 14 11:29:12 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:29:12 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:29:12 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk"/>
Nov 14 11:29:12 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:29:12 user nova-compute[75255]:     </disk>
Nov 14 11:29:12 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:29:12 user nova-compute[75255]:       <mac address="fa:16:3e:78:af:a9"/>
Nov 14 11:29:12 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:29:12 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:29:12 user nova-compute[75255]:       <target dev="tapfe5a2cb3-71"/>
Nov 14 11:29:12 user nova-compute[75255]:     </interface>
Nov 14 11:29:12 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:29:12 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/console.log" append="off"/>
Nov 14 11:29:12 user nova-compute[75255]:     </serial>
Nov 14 11:29:12 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:29:12 user nova-compute[75255]:     <video>
Nov 14 11:29:12 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:29:12 user nova-compute[75255]:     </video>
Nov 14 11:29:12 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:29:12 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:29:12 user nova-compute[75255]:     </rng>
Nov 14 11:29:12 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:29:12 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:29:12 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:29:12 user nova-compute[75255]:     </memballoon>
Nov 14 11:29:12 user nova-compute[75255]:   </devices>
Nov 14 11:29:12 user nova-compute[75255]: </domain>
Nov 14 11:29:12 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-531815042',display_name='tempest-TestStampPattern-server-531815042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-531815042',id=39,image_ref='66995d93-4111-4a4d-94bf-e15b4f3a2e58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+K+knKpNyZnoq/fwoIWr7QItDZQ5aLjEM7xC051cHvbV98q9oTME1VV23X8TxAqVI6fYWttj3e2KZ5Vhxbye8R2SGnCj7WIl6zRE+W17wWjn1nejVZq2nLaP4MQnIrw==',key_name='tempest-TestStampPattern-1486227609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9282a36a740403f8a65ede3b9405d22',ramdisk_id='',reservation_id='r-53yuxceg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a',image_min_disk='1',image_min_ram='0',image_owner_id='c9282a36a740403f8a65ede3b9405d22',image_owner_project_name='tempest-TestStampPattern-761473602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-761473602-project-member',image_user_id='a4e5f5081c1b4691a79b2839bfc8c124',network_allocated='True',owner_project_name='tempest-TestStampPattern-761473602',owner_user_name='tempest-TestStampPattern-761473602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:29:10Z,user_data=None,user_id='a4e5f5081c1b4691a79b2839bfc8c124',uuid=e574025a-2522-4796-8cdb-336bf8e14cd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converting VIF {"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:a9,bridge_name='br-int',has_traffic_filtering=True,id=fe5a2cb3-7102-4441-8906-cba971adb014,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5a2cb3-71') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG os_vif [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:a9,bridge_name='br-int',has_traffic_filtering=True,id=fe5a2cb3-7102-4441-8906-cba971adb014,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5a2cb3-71') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f41908b-96b2-53bd-9d58-049743597875', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe5a2cb3-71, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe5a2cb3-71, col_values=(('qos', UUID('9eb192a6-9858-4039-bd67-b078ab6952fa')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe5a2cb3-71, col_values=(('external_ids', {'iface-id': 'fe5a2cb3-7102-4441-8906-cba971adb014', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:af:a9', 'vm-uuid': 'e574025a-2522-4796-8cdb-336bf8e14cd3'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:29:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:12 user nova-compute[75255]: INFO os_vif [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:a9,bridge_name='br-int',has_traffic_filtering=True,id=fe5a2cb3-7102-4441-8906-cba971adb014,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5a2cb3-71')
Nov 14 11:29:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:29:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No VIF found with MAC fa:16:3e:78:af:a9, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-4fd52823-0bd9-4aa4-89b9-71ec7d79bf84 req-9aa8a5e2-4fe7-4b93-bd61-c7d49c45e82f service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4fd52823-0bd9-4aa4-89b9-71ec7d79bf84 req-9aa8a5e2-4fe7-4b93-bd61-c7d49c45e82f service nova] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4fd52823-0bd9-4aa4-89b9-71ec7d79bf84 req-9aa8a5e2-4fe7-4b93-bd61-c7d49c45e82f service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4fd52823-0bd9-4aa4-89b9-71ec7d79bf84 req-9aa8a5e2-4fe7-4b93-bd61-c7d49c45e82f service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-4fd52823-0bd9-4aa4-89b9-71ec7d79bf84 req-9aa8a5e2-4fe7-4b93-bd61-c7d49c45e82f service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] No waiting events found dispatching network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:29:14 user nova-compute[75255]: WARNING nova.compute.manager [req-4fd52823-0bd9-4aa4-89b9-71ec7d79bf84 req-9aa8a5e2-4fe7-4b93-bd61-c7d49c45e82f service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received unexpected event network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 for instance with vm_state building and task_state spawning.
Nov 14 11:29:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:29:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Instance spawned successfully.
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:29:16 user nova-compute[75255]: INFO nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-71242631-9906-4a9a-9354-6746d6db1771 req-9822171c-038d-4603-a699-aeb480c95852 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-71242631-9906-4a9a-9354-6746d6db1771 req-9822171c-038d-4603-a699-aeb480c95852 service nova] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-71242631-9906-4a9a-9354-6746d6db1771 req-9822171c-038d-4603-a699-aeb480c95852 service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-71242631-9906-4a9a-9354-6746d6db1771 req-9822171c-038d-4603-a699-aeb480c95852 service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-71242631-9906-4a9a-9354-6746d6db1771 req-9822171c-038d-4603-a699-aeb480c95852 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] No waiting events found dispatching network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:29:16 user nova-compute[75255]: WARNING nova.compute.manager [req-71242631-9906-4a9a-9354-6746d6db1771 req-9822171c-038d-4603-a699-aeb480c95852 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received unexpected event network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 for instance with vm_state building and task_state spawning.
Nov 14 11:29:16 user nova-compute[75255]: INFO nova.compute.manager [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Took 6.72 seconds to build instance.
Nov 14 11:29:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3906e351-cb0d-488d-90ae-33c91156c70f tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.815s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "2bb9fe90-561b-4cf2-a657-756594130121" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:26 user nova-compute[75255]: INFO nova.compute.manager [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Terminating instance
Nov 14 11:29:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce8c04aa-7f53-4143-a976-62dc2f507931 req-7e4dca46-0ec3-47fe-adb9-1b4179cf3d4f service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received event network-vif-unplugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce8c04aa-7f53-4143-a976-62dc2f507931 req-7e4dca46-0ec3-47fe-adb9-1b4179cf3d4f service nova] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce8c04aa-7f53-4143-a976-62dc2f507931 req-7e4dca46-0ec3-47fe-adb9-1b4179cf3d4f service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ce8c04aa-7f53-4143-a976-62dc2f507931 req-7e4dca46-0ec3-47fe-adb9-1b4179cf3d4f service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce8c04aa-7f53-4143-a976-62dc2f507931 req-7e4dca46-0ec3-47fe-adb9-1b4179cf3d4f service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] No waiting events found dispatching network-vif-unplugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:29:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-ce8c04aa-7f53-4143-a976-62dc2f507931 req-7e4dca46-0ec3-47fe-adb9-1b4179cf3d4f service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received event network-vif-unplugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Instance destroyed successfully.
Nov 14 11:29:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'resources' on Instance uuid 2bb9fe90-561b-4cf2-a657-756594130121 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944719245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944719245',id=30,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-xef3b5k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:22:02Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=2bb9fe90-561b-4cf2-a657-756594130121,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "address": "fa:16:3e:62:bb:24", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape610c225-9b", "ovs_interfaceid": "e610c225-9b38-4ad3-b93d-c98e43c5b6b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=e610c225-9b38-4ad3-b93d-c98e43c5b6b0,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape610c225-9b') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG os_vif [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=e610c225-9b38-4ad3-b93d-c98e43c5b6b0,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape610c225-9b') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape610c225-9b, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db18da38-a871-4ae7-b6ec-bb49e8333419) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:27 user nova-compute[75255]: INFO os_vif [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=e610c225-9b38-4ad3-b93d-c98e43c5b6b0,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape610c225-9b')
Nov 14 11:29:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Deleting instance files /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121_del
Nov 14 11:29:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Deletion of /opt/stack/data/nova/instances/2bb9fe90-561b-4cf2-a657-756594130121_del complete
Nov 14 11:29:27 user nova-compute[75255]: INFO nova.compute.manager [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 11:29:27 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:29:27 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Took 0.44 seconds to deallocate network for instance.
Nov 14 11:29:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:28 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Deleted allocations for instance 2bb9fe90-561b-4cf2-a657-756594130121
Nov 14 11:29:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27f5266a-e952-4c26-8a97-34b9fa82073d tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "2bb9fe90-561b-4cf2-a657-756594130121" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.722s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-8b9f3619-850f-42e9-b261-dc8c7c67d301 req-08afea27-4cfd-4b08-8bd5-1752876869f6 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received event network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8b9f3619-850f-42e9-b261-dc8c7c67d301 req-08afea27-4cfd-4b08-8bd5-1752876869f6 service nova] Acquiring lock "2bb9fe90-561b-4cf2-a657-756594130121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8b9f3619-850f-42e9-b261-dc8c7c67d301 req-08afea27-4cfd-4b08-8bd5-1752876869f6 service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8b9f3619-850f-42e9-b261-dc8c7c67d301 req-08afea27-4cfd-4b08-8bd5-1752876869f6 service nova] Lock "2bb9fe90-561b-4cf2-a657-756594130121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-8b9f3619-850f-42e9-b261-dc8c7c67d301 req-08afea27-4cfd-4b08-8bd5-1752876869f6 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] No waiting events found dispatching network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:29:28 user nova-compute[75255]: WARNING nova.compute.manager [req-8b9f3619-850f-42e9-b261-dc8c7c67d301 req-08afea27-4cfd-4b08-8bd5-1752876869f6 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received unexpected event network-vif-plugged-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 for instance with vm_state deleted and task_state None.
Nov 14 11:29:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-8b9f3619-850f-42e9-b261-dc8c7c67d301 req-08afea27-4cfd-4b08-8bd5-1752876869f6 service nova] [instance: 2bb9fe90-561b-4cf2-a657-756594130121] Received event network-vif-deleted-e610c225-9b38-4ad3-b93d-c98e43c5b6b0 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:33 user nova-compute[75255]: INFO nova.compute.manager [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Terminating instance
Nov 14 11:29:33 user nova-compute[75255]: DEBUG nova.compute.manager [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-111f925c-4d17-4b08-92cb-4a441396e483 req-544c39f1-b362-4a55-8f4d-ecaf74f55d87 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-unplugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-111f925c-4d17-4b08-92cb-4a441396e483 req-544c39f1-b362-4a55-8f4d-ecaf74f55d87 service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-111f925c-4d17-4b08-92cb-4a441396e483 req-544c39f1-b362-4a55-8f4d-ecaf74f55d87 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-111f925c-4d17-4b08-92cb-4a441396e483 req-544c39f1-b362-4a55-8f4d-ecaf74f55d87 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-111f925c-4d17-4b08-92cb-4a441396e483 req-544c39f1-b362-4a55-8f4d-ecaf74f55d87 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-unplugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG nova.compute.manager [req-111f925c-4d17-4b08-92cb-4a441396e483 req-544c39f1-b362-4a55-8f4d-ecaf74f55d87 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-unplugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:33 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Instance destroyed successfully.
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'resources' on Instance uuid eaf8bf74-7ef8-4eca-8098-0a675ca188cb {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112388371',display_name='tempest-ServerActionsTestOtherA-server-2112388371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112388371',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-2efmp59p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=eaf8bf74-7ef8-4eca-8098-0a675ca188cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "address": "fa:16:3e:2c:a0:12", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1108729-e7", "ovs_interfaceid": "b1108729-e7e5-4de3-99ba-daf01a2ca472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_vif [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1108729-e7, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc538dca-26da-47a2-8ec4-acc23d5353e1) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:34 user nova-compute[75255]: INFO os_vif [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:a0:12,bridge_name='br-int',has_traffic_filtering=True,id=b1108729-e7e5-4de3-99ba-daf01a2ca472,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1108729-e7')
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YioHzsSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:29:34 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ae3864-f8e1-4a8e-874f-a319cd326b45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:29:34 user nova-compute[75255]: No targets found.
Nov 14 11:29:34 user nova-compute[75255]: iSNS:
Nov 14 11:29:34 user nova-compute[75255]: No targets found.
Nov 14 11:29:34 user nova-compute[75255]: STATIC:
Nov 14 11:29:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb
Nov 14 11:29:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:29:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:29:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61
Nov 14 11:29:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:29:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:29:34 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:29:34 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:29:34 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:29:34 user nova-compute[75255]: FIRMWARE:
Nov 14 11:29:34 user nova-compute[75255]: No targets found.
Nov 14 11:29:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:29:34 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:29:34 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c57f8f-a956-47c3-a0a0-55d4cd637ab8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea653d-ddfd-4a28-8e8a-07d646ae354e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:29:34 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:29:34 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:29:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:29:34 user nova-compute[75255]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb (non-flash)
Nov 14 11:29:34 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:29:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68cc231-9761-40da-9f38-03cf033d14c5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[845897a2-1603-4081-8dd0-f643cc7372dd]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5abe79d-668a-4ac0-a12e-c6858255865b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc3b4d-ea39-486f-b1c8-b13d792c55a5]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8ff4fdbb', '/dev/disk/by-id/scsi-1SCST_BIO8ff4fdbb-6117e567c4169bd4', '/dev/disk/by-id/scsi-23631313765353637') {{(pid=86497) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 11:29:34 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_8ff4fdbb
Nov 14 11:29:34 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO8ff4fdbb-6117e567c4169bd4
Nov 14 11:29:34 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23631313765353637
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce7408-d49c-4826-8bc7-be7917ead0e9]: (4, None) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[993be5c9-cf77-486b-8f20-1c0f71a53201]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[da45fbaa-8432-48a4-b8f1-96e7108683c5]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260]
Nov 14 11:29:34 user nova-compute[75255]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb, portal: 172.16.0.220,3260] successful.
Nov 14 11:29:34 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5963f401-2e5e-471e-a7ff-142a1caaa3cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c532428-f799-4e25-a76c-885c10c88444]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] <== disconnect_volume: return (301ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:29:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Deleting instance files /opt/stack/data/nova/instances/eaf8bf74-7ef8-4eca-8098-0a675ca188cb_del
Nov 14 11:29:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Deletion of /opt/stack/data/nova/instances/eaf8bf74-7ef8-4eca-8098-0a675ca188cb_del complete
Nov 14 11:29:34 user nova-compute[75255]: INFO nova.compute.manager [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 11:29:34 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:29:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:35 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:35 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:29:35 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Took 0.97 seconds to deallocate network for instance.
Nov 14 11:29:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-414ce56e-0796-43f4-ad28-517923452f7f req-17a9a060-e8e3-476e-b8c8-d831a77d2880 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-414ce56e-0796-43f4-ad28-517923452f7f req-17a9a060-e8e3-476e-b8c8-d831a77d2880 service nova] Acquiring lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-414ce56e-0796-43f4-ad28-517923452f7f req-17a9a060-e8e3-476e-b8c8-d831a77d2880 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-414ce56e-0796-43f4-ad28-517923452f7f req-17a9a060-e8e3-476e-b8c8-d831a77d2880 service nova] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-414ce56e-0796-43f4-ad28-517923452f7f req-17a9a060-e8e3-476e-b8c8-d831a77d2880 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] No waiting events found dispatching network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:29:35 user nova-compute[75255]: WARNING nova.compute.manager [req-414ce56e-0796-43f4-ad28-517923452f7f req-17a9a060-e8e3-476e-b8c8-d831a77d2880 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received unexpected event network-vif-plugged-b1108729-e7e5-4de3-99ba-daf01a2ca472 for instance with vm_state active and task_state deleting.
Nov 14 11:29:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-414ce56e-0796-43f4-ad28-517923452f7f req-17a9a060-e8e3-476e-b8c8-d831a77d2880 service nova] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Received event network-vif-deleted-b1108729-e7e5-4de3-99ba-daf01a2ca472 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:36 user nova-compute[75255]: INFO nova.compute.manager [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 11:29:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: eaf8bf74-7ef8-4eca-8098-0a675ca188cb] Deleting volume: 5963f401-2e5e-471e-a7ff-142a1caaa3cb {{(pid=75255) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 11:29:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:36 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:29:36 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:29:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:36 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Deleted allocations for instance eaf8bf74-7ef8-4eca-8098-0a675ca188cb
Nov 14 11:29:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1049a475-2280-425c-8eb5-138bac77391b tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "eaf8bf74-7ef8-4eca-8098-0a675ca188cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.358s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:46 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:47 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:29:47 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8272MB free_disk=24.859302520751953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance b8825fce-bc47-40b6-818d-8dc4b4013a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance e574025a-2522-4796-8cdb-336bf8e14cd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:29:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:29:48 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:29:48 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:29:48 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:29:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-changed-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Refreshing instance network info cache due to event network-changed-025100a4-a2e8-44f9-8527-ffb21667e406. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] Acquiring lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] Acquired lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Refreshing network info cache for port 025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updated VIF entry in instance network info cache for port 025100a4-a2e8-44f9-8527-ffb21667e406. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG nova.network.neutron [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updating instance_info_cache with network_info: [{"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-6019bf31-150f-4f56-8e2a-0e195718f630 req-46302789-45f7-497a-9a2b-fe2d8bb18139 service nova] Releasing lock "refresh_cache-b8825fce-bc47-40b6-818d-8dc4b4013a3e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'flavor' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:50 user nova-compute[75255]: INFO nova.compute.manager [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Attaching volume dafa505d-5b98-4202-8aaa-edb002a2a1a3 to /dev/vdb
Nov 14 11:29:51 user nova-compute[75255]: DEBUG os_brick.utils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3edfd05-6eac-44c8-b313-ba7434c54e86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ffbf5e-7e9c-4749-8b0c-36c807cb43b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e8094-25ca-4c94-8e88-9a0c9a1febf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e19c368-afb8-4bbb-b500-5e39efd5cdbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:29:51 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd839454-419a-4b3d-aa16-48325250e759]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG os_brick.utils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updating existing volume attachment record: 0552a21a-3c78-464a-b7d6-a3c98c536e34 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [{"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-7976be6c-afb4-4ddf-ac33-ddbd8a23265e" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:29:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:52 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:29:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:29:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:55 user nova-compute[75255]: INFO nova.compute.manager [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Detaching volume ab6a3a66-526d-4c87-8c51-7994a8b7ca61
Nov 14 11:29:55 user nova-compute[75255]: INFO nova.virt.block_device [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Attempting to driver detach volume ab6a3a66-526d-4c87-8c51-7994a8b7ca61 from mountpoint /dev/vdc
Nov 14 11:29:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Attempting to detach device vdc from instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:29:55 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:29:55 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:29:55 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:29:55 user nova-compute[75255]:   <serial>ab6a3a66-526d-4c87-8c51-7994a8b7ca61</serial>
Nov 14 11:29:55 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:29:55 user nova-compute[75255]: </disk>
Nov 14 11:29:55 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:29:55 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully detached device vdc from instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e from the persistent domain config.
Nov 14 11:29:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:29:55 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:29:55 user nova-compute[75255]:   <source dev="/dev/sde"/>
Nov 14 11:29:55 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:29:55 user nova-compute[75255]:   <serial>ab6a3a66-526d-4c87-8c51-7994a8b7ca61</serial>
Nov 14 11:29:55 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:29:55 user nova-compute[75255]: </disk>
Nov 14 11:29:55 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKdOjAul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:29:55 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:29:55 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:29:55 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[883a781f-dbaf-4186-88e8-6a3d88a41dcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:29:55 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c2efe5-c8c3-4f5c-a3aa-e41e9a28476c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3] added
Nov 14 11:29:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0326ebd-efd8-4b63-80b4-db0886ee05ca]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8804de0f-395b-4b01-81ba-9918e18dca74]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gKdOjAul {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gKdOjAul" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4caf5d-aa33-4094-bcdb-9176ace8a261]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gKdOjAul'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245cb4a-853b-42c8-9eed-e5799aad6062]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0db9d-935d-4489-8e67-f0a174c4a926]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:29:55 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:29:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:29:55 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:29:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa788442-eeac-4d89-aa33-169363228587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260]
Nov 14 11:29:55 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260] successful.
Nov 14 11:29:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[81332b8f-ba3b-4a98-ae05-3217c636ab04]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[73244560-8aa4-4cc6-8f5b-f2093ab27770]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:29:55 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:29:55 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:29:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:29:55 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:29:55 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:29:55 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca37d05-b939-4f21-95e2-4b3cd7ae4346]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKdOjAul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:29:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:29:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:29:56 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23265316236323563', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:29:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265316236323563', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:29:56 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'flavor' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:29:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:29:56 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:29:56 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:29:56 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:29:56 user nova-compute[75255]:   <serial>dafa505d-5b98-4202-8aaa-edb002a2a1a3</serial>
Nov 14 11:29:56 user nova-compute[75255]: </disk>
Nov 14 11:29:56 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:29:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:29:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:29:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No VIF found with MAC fa:16:3e:70:e4:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:29:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d7322cff-2c2c-4007-ae43-3c99268dc5bc tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.360s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG nova.objects.instance [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'flavor' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:29:59 user nova-compute[75255]: INFO nova.compute.manager [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Attaching volume d7e9b55f-3806-49d2-be69-f989906a12af to /dev/vdc
Nov 14 11:29:59 user nova-compute[75255]: DEBUG os_brick.utils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f9420-4ccd-4740-aae4-ed7b893be890]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9aa06b-6355-48cc-98d8-11db629d3598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c242ed2-91b4-4796-b323-f048d2cfc84d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[03068ffc-1bc7-4c73-8a1a-d0706b75a962]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:29:59 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:29:59 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[971ccc25-026b-494e-bbcd-7488a860fea7]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG os_brick.utils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updating existing volume attachment record: 063f2c9e-3793-4d71-b5ed-79ceeb2894cc {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:29:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRtuxfYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:30:04 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:30:04 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:30:04 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e87565-72a4-4e89-8ca4-bf058e06fa31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:30:04 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[de33b91e-a21a-472d-a020-218fb6b6412f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af] added
Nov 14 11:30:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6008b9af-7c28-46d8-a181-17d02b090c19]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc744f8-e388-4e4d-b3de-1da8d48ba46a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRtuxfYW {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRtuxfYW" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beec375-a44a-40d9-86b5-d7bb3b89368b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRtuxfYW'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad26d77-9d28-4d9a-9c9b-4039f0f46e6e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a29e47-69be-433d-b052-f60b209a5a30]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b948187-01ea-4050-95ed-4c326de3861c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260]
Nov 14 11:30:04 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260] successful.
Nov 14 11:30:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c3f9c5-10dc-42ad-9e90-079307ad8593]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d6360-daba-4daa-833d-a9c17acbd7ec]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:04 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a17dd57-00cb-4bd1-a8c6-fa2754f80785]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRtuxfYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:30:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23463666538643339', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463666538643339', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG nova.objects.instance [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'flavor' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:30:05 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:30:05 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:30:05 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:30:05 user nova-compute[75255]:   <serial>d7e9b55f-3806-49d2-be69-f989906a12af</serial>
Nov 14 11:30:05 user nova-compute[75255]: </disk>
Nov 14 11:30:05 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:30:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] No VIF found with MAC fa:16:3e:70:e4:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:30:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45fbf56f-c742-442f-a9f4-504a874301fe tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.294s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:06 user nova-compute[75255]: INFO nova.compute.manager [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Detaching volume d7e9b55f-3806-49d2-be69-f989906a12af
Nov 14 11:30:06 user nova-compute[75255]: INFO nova.virt.block_device [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Attempting to driver detach volume d7e9b55f-3806-49d2-be69-f989906a12af from mountpoint /dev/vdc
Nov 14 11:30:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Attempting to detach device vdc from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:30:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:30:06 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:30:06 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:30:06 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:30:06 user nova-compute[75255]:   <serial>d7e9b55f-3806-49d2-be69-f989906a12af</serial>
Nov 14 11:30:06 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 11:30:06 user nova-compute[75255]: </disk>
Nov 14 11:30:06 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:30:06 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Successfully detached device vdc from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the persistent domain config.
Nov 14 11:30:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:30:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:30:06 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:30:06 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:30:06 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:30:06 user nova-compute[75255]:   <serial>d7e9b55f-3806-49d2-be69-f989906a12af</serial>
Nov 14 11:30:06 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 11:30:06 user nova-compute[75255]: </disk>
Nov 14 11:30:06 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:30:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:30:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:15 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e is timed out.
Nov 14 11:30:15 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully detached device vdc from instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e from the live domain config.
Nov 14 11:30:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTvgmSGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:30:15 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eac8bc-a51d-4b69-bfe6-9e4ae8226a75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:30:15 user nova-compute[75255]: No targets found.
Nov 14 11:30:15 user nova-compute[75255]: iSNS:
Nov 14 11:30:15 user nova-compute[75255]: No targets found.
Nov 14 11:30:15 user nova-compute[75255]: STATIC:
Nov 14 11:30:15 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af
Nov 14 11:30:15 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:15 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:15 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3
Nov 14 11:30:15 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:15 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:15 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61
Nov 14 11:30:15 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:15 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:15 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:30:15 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:15 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:15 user nova-compute[75255]: FIRMWARE:
Nov 14 11:30:15 user nova-compute[75255]: No targets found.
Nov 14 11:30:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:30:15 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:30:15 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b7e57-af10-4377-b21c-431f56636a48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0f203-d1c7-4a93-8c0f-54a1fdf4c5e2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:15 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:30:15 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:15 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:15 user nova-compute[75255]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 (non-flash)
Nov 14 11:30:15 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:15 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:15 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086c2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61'): ({'sde'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Removing single pathed devices sde {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:30:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[76039be8-c7b6-446a-bb15-77d850e89cae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6055c0dc-cce0-4428-85db-9824c327b9b9]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flushing IO for device /dev/sde {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fd157d-66de-435e-a379-5af3febb062a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8877d286-4462-4e3c-b086-de3f894cd4ef]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] SCSI volumes sde have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3fdca1-d959-43a2-b264-efb8ca93ef91]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec9d8ef-1c79-4ed8-81ab-56aaaa69564e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260]
Nov 14 11:30:16 user nova-compute[75255]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61, portal: 172.16.0.220,3260] successful.
Nov 14 11:30:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6a3a66-526d-4c87-8c51-7994a8b7ca61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0266fc4a-7ea6-4cf1-89a0-e06a4e8cfd56]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] <== disconnect_volume: return (313ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'flavor' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:30:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-035ae31d-502a-4c2f-8328-b434041385d3 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:17 user nova-compute[75255]: INFO nova.compute.manager [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Terminating instance
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-b9c0b832-a3f4-4cf7-9c8d-b35afb5d6f27 req-f8894317-cb40-45ed-bdfc-2cc8d57457c6 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9c0b832-a3f4-4cf7-9c8d-b35afb5d6f27 req-f8894317-cb40-45ed-bdfc-2cc8d57457c6 service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9c0b832-a3f4-4cf7-9c8d-b35afb5d6f27 req-f8894317-cb40-45ed-bdfc-2cc8d57457c6 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b9c0b832-a3f4-4cf7-9c8d-b35afb5d6f27 req-f8894317-cb40-45ed-bdfc-2cc8d57457c6 service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-b9c0b832-a3f4-4cf7-9c8d-b35afb5d6f27 req-f8894317-cb40-45ed-bdfc-2cc8d57457c6 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-b9c0b832-a3f4-4cf7-9c8d-b35afb5d6f27 req-f8894317-cb40-45ed-bdfc-2cc8d57457c6 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-unplugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Instance destroyed successfully.
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'resources' on Instance uuid 427d469e-db0a-48ef-bbed-92e8d7ad61fe {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1426869663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1426869663',id=22,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:16:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-h01gegs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:18:17Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=427d469e-db0a-48ef-bbed-92e8d7ad61fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "address": "fa:16:3e:bb:d8:f7", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7285d5-c7", "ovs_interfaceid": "6c7285d5-c7d6-4ad4-8d39-7428e2068659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_vif [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c7285d5-c7, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbdc9924-73fd-4a2c-8b74-90b21a29df84) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:17 user nova-compute[75255]: INFO os_vif [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6c7285d5-c7d6-4ad4-8d39-7428e2068659,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7285d5-c7')
Nov 14 11:30:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqhYfzRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:30:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[611f726d-81fe-4e0e-a2ee-55bb2ff2c433]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:30:17 user nova-compute[75255]: No targets found.
Nov 14 11:30:17 user nova-compute[75255]: iSNS:
Nov 14 11:30:17 user nova-compute[75255]: No targets found.
Nov 14 11:30:17 user nova-compute[75255]: STATIC:
Nov 14 11:30:17 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af
Nov 14 11:30:17 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:17 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:17 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3
Nov 14 11:30:17 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:17 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:17 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd
Nov 14 11:30:17 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:17 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:17 user nova-compute[75255]: FIRMWARE:
Nov 14 11:30:17 user nova-compute[75255]: No targets found.
Nov 14 11:30:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:30:17 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:30:17 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede3ad5-05d4-4889-bb4e-bff5998bde02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b142f-836d-4340-bbf3-d6116517ef31]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:17 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:17 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd (non-flash)
Nov 14 11:30:17 user nova-compute[75255]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:17 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd'): ({'sdd'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Removing single pathed devices sdd {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:30:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5318bffd-4a6b-482d-9531-6ba32dc54e3f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b8c3f8-6135-481c-9846-235bbce32ceb]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Flushing IO for device /dev/sdd {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4f7e2f-b240-44ab-9013-f21508d1b13b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804a5cc-8e62-4724-b5bc-e289f5e4296b]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c18f894-bc72-4b60-a013-0a7e6c336cdc]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f933f576-4d38-4b1d-9749-d8ef81b86af3]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260]
Nov 14 11:30:18 user nova-compute[75255]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd, portal: 172.16.0.220,3260] successful.
Nov 14 11:30:18 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59544be6-2339-4966-a957-b0f9dc8c60bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f4045-be9f-4a99-a83f-4d86db0fb1a4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] <== disconnect_volume: return (311ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:30:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Deleting instance files /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe_del
Nov 14 11:30:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Deletion of /opt/stack/data/nova/instances/427d469e-db0a-48ef-bbed-92e8d7ad61fe_del complete
Nov 14 11:30:18 user nova-compute[75255]: INFO nova.compute.manager [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 11:30:18 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:30:18 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Took 0.43 seconds to deallocate network for instance.
Nov 14 11:30:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-fbe4b55d-2a06-4619-8848-f18cc2759655 req-562c66a6-7dca-483c-bd4a-9e4ad6281419 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-deleted-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:18 user nova-compute[75255]: INFO nova.compute.manager [req-fbe4b55d-2a06-4619-8848-f18cc2759655 req-562c66a6-7dca-483c-bd4a-9e4ad6281419 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Neutron deleted interface 6c7285d5-c7d6-4ad4-8d39-7428e2068659; detaching it from the instance and deleting it from the info cache
Nov 14 11:30:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-fbe4b55d-2a06-4619-8848-f18cc2759655 req-562c66a6-7dca-483c-bd4a-9e4ad6281419 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:30:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-fbe4b55d-2a06-4619-8848-f18cc2759655 req-562c66a6-7dca-483c-bd4a-9e4ad6281419 service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Detach interface failed, port_id=6c7285d5-c7d6-4ad4-8d39-7428e2068659, reason: Instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-13c4d66e-a7a7-47a1-9d35-beefb2070d85 req-b22e4402-d634-4c37-bb14-d9fcb9d95e9b service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-13c4d66e-a7a7-47a1-9d35-beefb2070d85 req-b22e4402-d634-4c37-bb14-d9fcb9d95e9b service nova] Acquiring lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-13c4d66e-a7a7-47a1-9d35-beefb2070d85 req-b22e4402-d634-4c37-bb14-d9fcb9d95e9b service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-13c4d66e-a7a7-47a1-9d35-beefb2070d85 req-b22e4402-d634-4c37-bb14-d9fcb9d95e9b service nova] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG nova.compute.manager [req-13c4d66e-a7a7-47a1-9d35-beefb2070d85 req-b22e4402-d634-4c37-bb14-d9fcb9d95e9b service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] No waiting events found dispatching network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:30:19 user nova-compute[75255]: WARNING nova.compute.manager [req-13c4d66e-a7a7-47a1-9d35-beefb2070d85 req-b22e4402-d634-4c37-bb14-d9fcb9d95e9b service nova] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Received unexpected event network-vif-plugged-6c7285d5-c7d6-4ad4-8d39-7428e2068659 for instance with vm_state active and task_state deleting.
Nov 14 11:30:19 user nova-compute[75255]: INFO nova.compute.manager [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 427d469e-db0a-48ef-bbed-92e8d7ad61fe] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 11:30:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:30:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:19 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Deleted allocations for instance 427d469e-db0a-48ef-bbed-92e8d7ad61fe
Nov 14 11:30:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7e6a5a89-c303-42e0-9992-74a67bf70bea tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "427d469e-db0a-48ef-bbed-92e8d7ad61fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:26 user nova-compute[75255]: INFO nova.compute.manager [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Terminating instance
Nov 14 11:30:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-bbacfdf0-6602-4eaf-a195-5364c94058d0 req-c031c910-bae8-4215-8750-6f1fad27ccd8 service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-vif-unplugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bbacfdf0-6602-4eaf-a195-5364c94058d0 req-c031c910-bae8-4215-8750-6f1fad27ccd8 service nova] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bbacfdf0-6602-4eaf-a195-5364c94058d0 req-c031c910-bae8-4215-8750-6f1fad27ccd8 service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-bbacfdf0-6602-4eaf-a195-5364c94058d0 req-c031c910-bae8-4215-8750-6f1fad27ccd8 service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-bbacfdf0-6602-4eaf-a195-5364c94058d0 req-c031c910-bae8-4215-8750-6f1fad27ccd8 service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] No waiting events found dispatching network-vif-unplugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:30:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-bbacfdf0-6602-4eaf-a195-5364c94058d0 req-c031c910-bae8-4215-8750-6f1fad27ccd8 service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-vif-unplugged-7492baa9-355a-4952-b448-c87d075c46d5 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:30:26 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Instance destroyed successfully.
Nov 14 11:30:26 user nova-compute[75255]: DEBUG nova.objects.instance [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lazy-loading 'resources' on Instance uuid 8d0e0752-e32b-4696-abb1-9ca53cae10fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:30:26 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e is timed out.
Nov 14 11:30:26 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Successfully detached device vdc from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the live domain config.
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRtuxfYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:30:27 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915451133',display_name='tempest-ServerActionsTestOtherA-server-915451133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915451133',id=17,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW0eFl40A5q7vd0k3kNyjs1viCANacRTbSOp33/9QOWCA9jsGZZrsV/eDl2CD0+xO0rVpMBQsV6PYggfIzRWkblVgGoEY600BThpzs4LWlMre7fs/DCrPhi9WN1BS6F8g==',key_name='tempest-keypair-313510823',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d1dfe665b5444728fff969e0156d205',ramdisk_id='',reservation_id='r-dg3had01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1585033744',owner_user_name='tempest-ServerActionsTestOtherA-1585033744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31467e0715d645ecbfbb209e8eba66ed',uuid=8d0e0752-e32b-4696-abb1-9ca53cae10fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converting VIF {"id": "7492baa9-355a-4952-b448-c87d075c46d5", "address": "fa:16:3e:d9:be:e6", "network": {"id": "1224f622-1cc0-4fd0-9b82-e2265a8387b0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1050170865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1dfe665b5444728fff969e0156d205", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7492baa9-35", "ovs_interfaceid": "7492baa9-355a-4952-b448-c87d075c46d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:be:e6,bridge_name='br-int',has_traffic_filtering=True,id=7492baa9-355a-4952-b448-c87d075c46d5,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7492baa9-35') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_vif [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:be:e6,bridge_name='br-int',has_traffic_filtering=True,id=7492baa9-355a-4952-b448-c87d075c46d5,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7492baa9-35') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7492baa9-35, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41b78224-8c99-4863-bb33-5eb9a3c0c023) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:30:27 user nova-compute[75255]: INFO os_vif [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:be:e6,bridge_name='br-int',has_traffic_filtering=True,id=7492baa9-355a-4952-b448-c87d075c46d5,network=Network(1224f622-1cc0-4fd0-9b82-e2265a8387b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7492baa9-35')
Nov 14 11:30:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Deleting instance files /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc_del
Nov 14 11:30:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Deletion of /opt/stack/data/nova/instances/8d0e0752-e32b-4696-abb1-9ca53cae10fc_del complete
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3d01e-6256-43b6-8643-72c530fe111a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:30:27 user nova-compute[75255]: No targets found.
Nov 14 11:30:27 user nova-compute[75255]: iSNS:
Nov 14 11:30:27 user nova-compute[75255]: No targets found.
Nov 14 11:30:27 user nova-compute[75255]: STATIC:
Nov 14 11:30:27 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af
Nov 14 11:30:27 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:27 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:27 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3
Nov 14 11:30:27 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:30:27 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:30:27 user nova-compute[75255]: FIRMWARE:
Nov 14 11:30:27 user nova-compute[75255]: No targets found.
Nov 14 11:30:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:30:27 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:30:27 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[762926f0-1761-4cc4-9f3e-a3403e077ea4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bee5d6-cc41-4698-9fc2-ed206e54320f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:27 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:30:27 user nova-compute[75255]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af (non-flash)
Nov 14 11:30:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086c9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: INFO nova.compute.manager [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[805bb3f8-64a0-4649-b4d3-09e9fe8aef30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e07544f-b543-4aa1-a384-8f84fc7f934a]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed248be2-2d9b-422e-91f0-554b44b38bfb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf97dec-6d86-43a0-9027-f68241ab7263]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.084s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[863cb8df-df13-44c6-a986-1336dc8da528]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a46d4a8-593f-4369-bf57-4d41109edf19]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260]
Nov 14 11:30:27 user nova-compute[75255]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af, portal: 172.16.0.220,3260] successful.
Nov 14 11:30:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e9b55f-3806-49d2-be69-f989906a12af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2874a4d-5a09-477c-bd4a-3df1141a6ce9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] <== disconnect_volume: return (361ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:30:27 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Took 0.47 seconds to deallocate network for instance.
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-4e7d54bc-a9d9-4500-b85f-7c013d0af99b req-ae0070d2-c11d-463d-9d6d-f7d578bbe89b service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-vif-deleted-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:27 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Deleted allocations for instance 8d0e0752-e32b-4696-abb1-9ca53cae10fc
Nov 14 11:30:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9f61a05d-d0c3-44e5-8f24-ef8a28c2d6c1 tempest-ServerActionsTestOtherA-1585033744 tempest-ServerActionsTestOtherA-1585033744-project-member] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:28 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'flavor' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:30:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6477291c-2a7a-4e93-9939-c7be0cae4cc4 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-4c101114-e9f2-4601-aa1b-c40d37e08399 req-5584702e-4494-46f4-9a3b-f2fb54c929e8 service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received event network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4c101114-e9f2-4601-aa1b-c40d37e08399 req-5584702e-4494-46f4-9a3b-f2fb54c929e8 service nova] Acquiring lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4c101114-e9f2-4601-aa1b-c40d37e08399 req-5584702e-4494-46f4-9a3b-f2fb54c929e8 service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4c101114-e9f2-4601-aa1b-c40d37e08399 req-5584702e-4494-46f4-9a3b-f2fb54c929e8 service nova] Lock "8d0e0752-e32b-4696-abb1-9ca53cae10fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-4c101114-e9f2-4601-aa1b-c40d37e08399 req-5584702e-4494-46f4-9a3b-f2fb54c929e8 service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] No waiting events found dispatching network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:30:28 user nova-compute[75255]: WARNING nova.compute.manager [req-4c101114-e9f2-4601-aa1b-c40d37e08399 req-5584702e-4494-46f4-9a3b-f2fb54c929e8 service nova] [instance: 8d0e0752-e32b-4696-abb1-9ca53cae10fc] Received unexpected event network-vif-plugged-7492baa9-355a-4952-b448-c87d075c46d5 for instance with vm_state deleted and task_state None.
Nov 14 11:30:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:30:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:45 user nova-compute[75255]: INFO nova.compute.manager [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Terminating instance
Nov 14 11:30:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-4a261ed4-debb-4f5b-9b8d-2d6f23cfc5e9 req-2a8adf80-a4df-489a-b8b1-e2296232166c service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-unplugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4a261ed4-debb-4f5b-9b8d-2d6f23cfc5e9 req-2a8adf80-a4df-489a-b8b1-e2296232166c service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4a261ed4-debb-4f5b-9b8d-2d6f23cfc5e9 req-2a8adf80-a4df-489a-b8b1-e2296232166c service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4a261ed4-debb-4f5b-9b8d-2d6f23cfc5e9 req-2a8adf80-a4df-489a-b8b1-e2296232166c service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-4a261ed4-debb-4f5b-9b8d-2d6f23cfc5e9 req-2a8adf80-a4df-489a-b8b1-e2296232166c service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-unplugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:30:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-4a261ed4-debb-4f5b-9b8d-2d6f23cfc5e9 req-2a8adf80-a4df-489a-b8b1-e2296232166c service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-unplugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:30:46 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Instance destroyed successfully.
Nov 14 11:30:46 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'resources' on Instance uuid 7976be6c-afb4-4ddf-ac33-ddbd8a23265e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984960086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984960086',id=34,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkig5pg750P4RIFQnqNLC/Mj9a0A19astPZfi6byTXL6e6EfI3unEeWVANHnucwQKGZRidB6ciCLZOg4qqyrZIl6EnDHhsUbPcN08n0FQuCBZRCo7ozmRH+1BoerVVygA==',key_name='tempest-keypair-1100144298',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:28:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-90adzxhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=7976be6c-afb4-4ddf-ac33-ddbd8a23265e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "address": "fa:16:3e:2f:00:7c", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe93b8c3-8a", "ovs_interfaceid": "be93b8c3-8ade-4f96-b9b5-8da5cac2cd49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG os_vif [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe93b8c3-8a, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1baafeec-2c5e-4ee2-9088-7050753b6fe0) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:46 user nova-compute[75255]: INFO os_vif [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:00:7c,bridge_name='br-int',has_traffic_filtering=True,id=be93b8c3-8ade-4f96-b9b5-8da5cac2cd49,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe93b8c3-8a')
Nov 14 11:30:46 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Deleting instance files /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e_del
Nov 14 11:30:46 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Deletion of /opt/stack/data/nova/instances/7976be6c-afb4-4ddf-ac33-ddbd8a23265e_del complete
Nov 14 11:30:46 user nova-compute[75255]: INFO nova.compute.manager [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 11:30:46 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:30:46 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:30:47 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Took 0.74 seconds to deallocate network for instance.
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:47 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Deleted allocations for instance 7976be6c-afb4-4ddf-ac33-ddbd8a23265e
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e36ab4d1-ce60-4013-a430-119ac282d8e7 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-ca9bc825-e230-49a5-bce9-40c9266fa44e req-4e89abe6-af5e-41a7-8cda-9213f82bc1d9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ca9bc825-e230-49a5-bce9-40c9266fa44e req-4e89abe6-af5e-41a7-8cda-9213f82bc1d9 service nova] Acquiring lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ca9bc825-e230-49a5-bce9-40c9266fa44e req-4e89abe6-af5e-41a7-8cda-9213f82bc1d9 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ca9bc825-e230-49a5-bce9-40c9266fa44e req-4e89abe6-af5e-41a7-8cda-9213f82bc1d9 service nova] Lock "7976be6c-afb4-4ddf-ac33-ddbd8a23265e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-ca9bc825-e230-49a5-bce9-40c9266fa44e req-4e89abe6-af5e-41a7-8cda-9213f82bc1d9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] No waiting events found dispatching network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:30:47 user nova-compute[75255]: WARNING nova.compute.manager [req-ca9bc825-e230-49a5-bce9-40c9266fa44e req-4e89abe6-af5e-41a7-8cda-9213f82bc1d9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received unexpected event network-vif-plugged-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 for instance with vm_state deleted and task_state None.
Nov 14 11:30:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-ca9bc825-e230-49a5-bce9-40c9266fa44e req-4e89abe6-af5e-41a7-8cda-9213f82bc1d9 service nova] [instance: 7976be6c-afb4-4ddf-ac33-ddbd8a23265e] Received event network-vif-deleted-be93b8c3-8ade-4f96-b9b5-8da5cac2cd49 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:30:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:30:48 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:30:49 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:30:49 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8549MB free_disk=24.912765502929688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance b8825fce-bc47-40b6-818d-8dc4b4013a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance e574025a-2522-4796-8cdb-336bf8e14cd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:30:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:30:50 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:30:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:30:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:30:52 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:30:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:30:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:30:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:30:56 user nova-compute[75255]: INFO nova.compute.manager [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Detaching volume dafa505d-5b98-4202-8aaa-edb002a2a1a3
Nov 14 11:30:56 user nova-compute[75255]: INFO nova.virt.block_device [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Attempting to driver detach volume dafa505d-5b98-4202-8aaa-edb002a2a1a3 from mountpoint /dev/vdb
Nov 14 11:30:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Attempting to detach device vdb from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:30:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:30:57 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:30:57 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:30:57 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:30:57 user nova-compute[75255]:   <serial>dafa505d-5b98-4202-8aaa-edb002a2a1a3</serial>
Nov 14 11:30:57 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:30:57 user nova-compute[75255]: </disk>
Nov 14 11:30:57 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:30:57 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Successfully detached device vdb from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the persistent domain config.
Nov 14 11:30:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:30:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:30:57 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:30:57 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:30:57 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:30:57 user nova-compute[75255]:   <serial>dafa505d-5b98-4202-8aaa-edb002a2a1a3</serial>
Nov 14 11:30:57 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:30:57 user nova-compute[75255]: </disk>
Nov 14 11:30:57 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:30:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-changed-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Refreshing instance network info cache due to event network-changed-fe5a2cb3-7102-4441-8906-cba971adb014. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] Acquiring lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] Acquired lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Refreshing network info cache for port fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updated VIF entry in instance network info cache for port fe5a2cb3-7102-4441-8906-cba971adb014. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updating instance_info_cache with network_info: [{"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a8e47b4e-d17a-4209-ab3e-33d9e7b86bcb req-3ce74ee6-c48c-4552-bc9c-803c2dc9a563 service nova] Releasing lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'flavor' on Instance uuid e574025a-2522-4796-8cdb-336bf8e14cd3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:02 user nova-compute[75255]: INFO nova.compute.manager [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Attaching volume 0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e to /dev/vdb
Nov 14 11:31:02 user nova-compute[75255]: DEBUG os_brick.utils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7185c4-a413-4748-a3b6-9c08249a5046]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c5e577-7629-498a-ad08-3f730509809e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d0dd98-c606-4e39-8daa-c589d3bb19e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[079cd64c-bb81-458b-ab50-4b93160cf367]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:31:02 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:31:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f2eec-c9fd-4071-b18f-7c3554f61c02]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG os_brick.utils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:31:02 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updating existing volume attachment record: b8270646-9283-45dc-a817-effded95cedd {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:31:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayqgOICY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:31:06 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:31:06 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:31:06 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[41702d0e-9b58-404d-aca8-03d7cf09f9b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:31:06 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[68699b98-4f4d-4847-ad51-cc609e03a24a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e] added
Nov 14 11:31:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e6a375-a0bc-48d5-a8b8-5639ea0bb322]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220be32-094b-47f1-90bd-c0860eed60bf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ayqgOICY {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ayqgOICY" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[27744e01-845c-4904-8daa-dbe4c9bc9885]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ayqgOICY'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ea5f0-3c60-4282-bfa7-bd03544ca854]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2c9883-3814-4330-9059-6d95ce9d1ca4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:31:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:31:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[458057bc-fb7a-4065-852d-18bdf14d133d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260]
Nov 14 11:31:06 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260] successful.
Nov 14 11:31:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebb95a7-1cd4-44ac-84f3-0f3e09c9a7b8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b646cc36-d9f3-4ece-a9db-c42a7682a52a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:31:06 user nova-compute[75255]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)
Nov 14 11:31:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:31:06 user nova-compute[75255]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)
Nov 14 11:31:06 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0467962-62f0-4629-ae35-2409e9b89203]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:06 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayqgOICY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23966386335353434', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966386335353434', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'flavor' on Instance uuid e574025a-2522-4796-8cdb-336bf8e14cd3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:31:07 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:31:07 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:31:07 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:31:07 user nova-compute[75255]:   <serial>0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e</serial>
Nov 14 11:31:07 user nova-compute[75255]: </disk>
Nov 14 11:31:07 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:07 user nova-compute[75255]: INFO nova.compute.manager [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Terminating instance
Nov 14 11:31:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-19b548ea-319f-416c-a9c2-ab3376761b7d req-400624e4-63c5-4d2a-b8c1-d497fb92e685 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received event network-vif-unplugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-19b548ea-319f-416c-a9c2-ab3376761b7d req-400624e4-63c5-4d2a-b8c1-d497fb92e685 service nova] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-19b548ea-319f-416c-a9c2-ab3376761b7d req-400624e4-63c5-4d2a-b8c1-d497fb92e685 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-19b548ea-319f-416c-a9c2-ab3376761b7d req-400624e4-63c5-4d2a-b8c1-d497fb92e685 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-19b548ea-319f-416c-a9c2-ab3376761b7d req-400624e4-63c5-4d2a-b8c1-d497fb92e685 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] No waiting events found dispatching network-vif-unplugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-19b548ea-319f-416c-a9c2-ab3376761b7d req-400624e4-63c5-4d2a-b8c1-d497fb92e685 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received event network-vif-unplugged-f73601c1-a2b3-45dd-9174-fd98d9300035 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] No VIF found with MAC fa:16:3e:78:af:a9, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e06a34d0-ef8e-409c-9b65-b16c90a4a05e tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.228s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Instance destroyed successfully.
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.objects.instance [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lazy-loading 'resources' on Instance uuid 24e046fb-04f4-49f8-bfa8-951334e25e5f {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-74556287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-74556287',id=16,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb07eaf3ea24939aeef6eba1bb2293d',ramdisk_id='',reservation_id='r-dv80n202',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:13:29Z,user_data=None,user_id='3b82af4602b649889188f0f943c63896',uuid=24e046fb-04f4-49f8-bfa8-951334e25e5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converting VIF {"id": "f73601c1-a2b3-45dd-9174-fd98d9300035", "address": "fa:16:3e:7c:d0:95", "network": {"id": "71265ff8-92bd-4425-996c-ba4e3117af2d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039145664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb07eaf3ea24939aeef6eba1bb2293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73601c1-a2", "ovs_interfaceid": "f73601c1-a2b3-45dd-9174-fd98d9300035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d0:95,bridge_name='br-int',has_traffic_filtering=True,id=f73601c1-a2b3-45dd-9174-fd98d9300035,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73601c1-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG os_vif [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d0:95,bridge_name='br-int',has_traffic_filtering=True,id=f73601c1-a2b3-45dd-9174-fd98d9300035,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73601c1-a2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf73601c1-a2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4cb603d-1d79-4124-ac8a-d58b5be73cd9) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:08 user nova-compute[75255]: INFO os_vif [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d0:95,bridge_name='br-int',has_traffic_filtering=True,id=f73601c1-a2b3-45dd-9174-fd98d9300035,network=Network(71265ff8-92bd-4425-996c-ba4e3117af2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73601c1-a2')
Nov 14 11:31:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Deleting instance files /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f_del
Nov 14 11:31:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Deletion of /opt/stack/data/nova/instances/24e046fb-04f4-49f8-bfa8-951334e25e5f_del complete
Nov 14 11:31:08 user nova-compute[75255]: INFO nova.compute.manager [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 14 11:31:08 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:31:08 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:31:09 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Took 0.72 seconds to deallocate network for instance.
Nov 14 11:31:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-1bf56e01-dc1e-4103-838a-adcdfb63fef0 req-22f1171b-4bc9-43dc-872e-5954139e93cb service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received event network-vif-deleted-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:09 user nova-compute[75255]: INFO nova.compute.manager [req-1bf56e01-dc1e-4103-838a-adcdfb63fef0 req-22f1171b-4bc9-43dc-872e-5954139e93cb service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Neutron deleted interface f73601c1-a2b3-45dd-9174-fd98d9300035; detaching it from the instance and deleting it from the info cache
Nov 14 11:31:09 user nova-compute[75255]: DEBUG nova.network.neutron [req-1bf56e01-dc1e-4103-838a-adcdfb63fef0 req-22f1171b-4bc9-43dc-872e-5954139e93cb service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-1bf56e01-dc1e-4103-838a-adcdfb63fef0 req-22f1171b-4bc9-43dc-872e-5954139e93cb service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Detach interface failed, port_id=f73601c1-a2b3-45dd-9174-fd98d9300035, reason: Instance 24e046fb-04f4-49f8-bfa8-951334e25e5f could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:09 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Deleted allocations for instance 24e046fb-04f4-49f8-bfa8-951334e25e5f
Nov 14 11:31:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa072121-1f47-40a7-bd32-02a3191a0a24 tempest-ServerBootFromVolumeStableRescueTest-1912178200 tempest-ServerBootFromVolumeStableRescueTest-1912178200-project-member] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:10 user nova-compute[75255]: INFO nova.compute.manager [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Detaching volume 0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e
Nov 14 11:31:10 user nova-compute[75255]: INFO nova.virt.block_device [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Attempting to driver detach volume 0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e from mountpoint /dev/vdb
Nov 14 11:31:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Attempting to detach device vdb from instance e574025a-2522-4796-8cdb-336bf8e14cd3 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:31:10 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:31:10 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:31:10 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:31:10 user nova-compute[75255]:   <serial>0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e</serial>
Nov 14 11:31:10 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:31:10 user nova-compute[75255]: </disk>
Nov 14 11:31:10 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:31:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully detached device vdb from instance e574025a-2522-4796-8cdb-336bf8e14cd3 from the persistent domain config.
Nov 14 11:31:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e574025a-2522-4796-8cdb-336bf8e14cd3 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:31:10 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:31:10 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:31:10 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:31:10 user nova-compute[75255]:   <serial>0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e</serial>
Nov 14 11:31:10 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:31:10 user nova-compute[75255]: </disk>
Nov 14 11:31:10 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-e771d0d3-bc32-4265-b733-57ce4c092ea7 req-d6ecd032-c82a-4675-969e-c1bfbdbdf8e0 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received event network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e771d0d3-bc32-4265-b733-57ce4c092ea7 req-d6ecd032-c82a-4675-969e-c1bfbdbdf8e0 service nova] Acquiring lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e771d0d3-bc32-4265-b733-57ce4c092ea7 req-d6ecd032-c82a-4675-969e-c1bfbdbdf8e0 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e771d0d3-bc32-4265-b733-57ce4c092ea7 req-d6ecd032-c82a-4675-969e-c1bfbdbdf8e0 service nova] Lock "24e046fb-04f4-49f8-bfa8-951334e25e5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-e771d0d3-bc32-4265-b733-57ce4c092ea7 req-d6ecd032-c82a-4675-969e-c1bfbdbdf8e0 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] No waiting events found dispatching network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:31:10 user nova-compute[75255]: WARNING nova.compute.manager [req-e771d0d3-bc32-4265-b733-57ce4c092ea7 req-d6ecd032-c82a-4675-969e-c1bfbdbdf8e0 service nova] [instance: 24e046fb-04f4-49f8-bfa8-951334e25e5f] Received unexpected event network-vif-plugged-f73601c1-a2b3-45dd-9174-fd98d9300035 for instance with vm_state deleted and task_state None.
Nov 14 11:31:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e574025a-2522-4796-8cdb-336bf8e14cd3 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:31:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:17 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e is timed out.
Nov 14 11:31:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Successfully detached device vdb from instance b8825fce-bc47-40b6-818d-8dc4b4013a3e from the live domain config.
Nov 14 11:31:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKdOjAul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:31:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03db6c0-a82c-4109-a409-d134e0f3d69d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:31:17 user nova-compute[75255]: No targets found.
Nov 14 11:31:17 user nova-compute[75255]: iSNS:
Nov 14 11:31:17 user nova-compute[75255]: No targets found.
Nov 14 11:31:17 user nova-compute[75255]: STATIC:
Nov 14 11:31:17 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e
Nov 14 11:31:17 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:31:17 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:31:17 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3
Nov 14 11:31:17 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:31:17 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:31:17 user nova-compute[75255]: FIRMWARE:
Nov 14 11:31:17 user nova-compute[75255]: No targets found.
Nov 14 11:31:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:31:17 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:31:17 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bb6bb3-6ae6-4ec3-8b2a-bd5dec8a2753]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9078c4b4-7f95-4a30-8415-626957b68943]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:31:17 user nova-compute[75255]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)
Nov 14 11:31:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 (non-flash)
Nov 14 11:31:17 user nova-compute[75255]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)
Nov 14 11:31:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30869bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[99728685-66ea-4861-b706-c77f0e2b21e2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a68d64-ea1e-4ff6-97c6-e225a3ad0297]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f3e263-723b-4e21-8b74-01fe2c5d5720]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6e6981-1f09-4242-80a9-02b693115cad]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c197e0c-1af3-4ff9-ab3b-6b4deca69100]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed7f831-8740-419b-be4b-1e36c2964d09]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260]
Nov 14 11:31:17 user nova-compute[75255]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3, portal: 172.16.0.220,3260] successful.
Nov 14 11:31:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dafa505d-5b98-4202-8aaa-edb002a2a1a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c32f671-dba6-4a37-9edd-6658cb0db7c6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] <== disconnect_volume: return (288ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:31:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'flavor' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-cd057ec0-e02f-4c2b-8f5b-65ebad2372f3 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:30 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e574025a-2522-4796-8cdb-336bf8e14cd3 is timed out.
Nov 14 11:31:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully detached device vdb from instance e574025a-2522-4796-8cdb-336bf8e14cd3 from the live domain config.
Nov 14 11:31:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayqgOICY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:31:30 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1723d5f-2136-4fd8-9c64-9298b908ebfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:31:30 user nova-compute[75255]: No targets found.
Nov 14 11:31:30 user nova-compute[75255]: iSNS:
Nov 14 11:31:30 user nova-compute[75255]: No targets found.
Nov 14 11:31:30 user nova-compute[75255]: STATIC:
Nov 14 11:31:30 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e
Nov 14 11:31:30 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:31:30 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:31:30 user nova-compute[75255]: FIRMWARE:
Nov 14 11:31:30 user nova-compute[75255]: No targets found.
Nov 14 11:31:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:31:30 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:31:30 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0071ac-bc73-4734-82f8-de5f9d5c3e27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fd6204-5e50-4ac7-8dea-62545364855b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)
Nov 14 11:31:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e (non-flash)
Nov 14 11:31:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb139fa6-a09c-4e5b-8adc-d3741873121c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[906011d5-9c3d-4c48-99e5-d6b358414b2e]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a16b5-f46c-46f6-ae02-37b580c3def4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c0440-03c0-4168-b051-48f150f466ad]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd87ae8-3d1d-455a-9f71-145bb4430b60]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f70fafe-84dc-4f42-bd6b-675b04000820]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260]
Nov 14 11:31:30 user nova-compute[75255]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e, portal: 172.16.0.220,3260] successful.
Nov 14 11:31:30 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3907b4-f2ae-48b9-b1cd-8998f8cedf3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5eda46-f209-4df3-9e9a-8c29c681a161]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] <== disconnect_volume: return (295ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:31:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:31:31 user nova-compute[75255]: DEBUG nova.objects.instance [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'flavor' on Instance uuid e574025a-2522-4796-8cdb-336bf8e14cd3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-14cba066-bb78-460a-98dc-27771b097904 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.999s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:34 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:31:39 user nova-compute[75255]: INFO nova.compute.claims [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Claim successful on node user
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.network.neutron [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:31:39 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.policy [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b4b049ae1654b4495e42b8ec2cb11f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539e7facdc2a4ce081fa5eff222d0193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:31:39 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Creating image(s)
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk 1073741824" returned: 0 in 0.060s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.239s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG nova.network.neutron [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Successfully created port: e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Cannot resize image /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Ensure instance console log exists: /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:40 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Successfully updated port: e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing instance network info cache due to event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.neutron [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance network_info: |[{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.neutron [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Start _get_guest_xml network_info=[{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:31:41 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:31:41 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671095676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671095676',id=40,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEZcydkis+nH8CQnz/LYXSN9dvLCB+pcr0dr8cD7m7ye5Orf8bOOSZGeYsILUEiXIcPpGZieKtNVBn5VN0xDrk0UgY4kzTDulN239RlNgWWCu0p30El9KShBCOmZlhPdQ==',key_name='tempest-keypair-2111564517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-bvowop90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=4d79ec1c-ad29-4b5f-a5d0-2993d70b2639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.objects.instance [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:31:41 user nova-compute[75255]:   <uuid>4d79ec1c-ad29-4b5f-a5d0-2993d70b2639</uuid>
Nov 14 11:31:41 user nova-compute[75255]:   <name>instance-00000028</name>
Nov 14 11:31:41 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:31:41 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:31:41 user nova-compute[75255]:   <metadata>
Nov 14 11:31:41 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:31:41 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:31:41 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-671095676</nova:name>
Nov 14 11:31:41 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:31:41</nova:creationTime>
Nov 14 11:31:41 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:31:41 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:31:41 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:31:41 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:31:41 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:31:41 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:31:41 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:31:41 user nova-compute[75255]:       <nova:owner>
Nov 14 11:31:41 user nova-compute[75255]:         <nova:user uuid="7b4b049ae1654b4495e42b8ec2cb11f9">tempest-AttachVolumeShelveTestJSON-479009518-project-member</nova:user>
Nov 14 11:31:41 user nova-compute[75255]:         <nova:project uuid="539e7facdc2a4ce081fa5eff222d0193">tempest-AttachVolumeShelveTestJSON-479009518</nova:project>
Nov 14 11:31:41 user nova-compute[75255]:       </nova:owner>
Nov 14 11:31:41 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:31:41 user nova-compute[75255]:       <nova:ports>
Nov 14 11:31:41 user nova-compute[75255]:         <nova:port uuid="e39ee0d8-cb8e-4456-806d-6b0935f109e1">
Nov 14 11:31:41 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 11:31:41 user nova-compute[75255]:         </nova:port>
Nov 14 11:31:41 user nova-compute[75255]:       </nova:ports>
Nov 14 11:31:41 user nova-compute[75255]:     </nova:instance>
Nov 14 11:31:41 user nova-compute[75255]:   </metadata>
Nov 14 11:31:41 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:31:41 user nova-compute[75255]:     <system>
Nov 14 11:31:41 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:31:41 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:31:41 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:31:41 user nova-compute[75255]:       <entry name="serial">4d79ec1c-ad29-4b5f-a5d0-2993d70b2639</entry>
Nov 14 11:31:41 user nova-compute[75255]:       <entry name="uuid">4d79ec1c-ad29-4b5f-a5d0-2993d70b2639</entry>
Nov 14 11:31:41 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:31:41 user nova-compute[75255]:     </system>
Nov 14 11:31:41 user nova-compute[75255]:   </sysinfo>
Nov 14 11:31:41 user nova-compute[75255]:   <os>
Nov 14 11:31:41 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:31:41 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:31:41 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:31:41 user nova-compute[75255]:   </os>
Nov 14 11:31:41 user nova-compute[75255]:   <features>
Nov 14 11:31:41 user nova-compute[75255]:     <acpi/>
Nov 14 11:31:41 user nova-compute[75255]:     <apic/>
Nov 14 11:31:41 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:31:41 user nova-compute[75255]:   </features>
Nov 14 11:31:41 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:31:41 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:31:41 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:31:41 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:31:41 user nova-compute[75255]:   </clock>
Nov 14 11:31:41 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:31:41 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:31:41 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:31:41 user nova-compute[75255]:   </cpu>
Nov 14 11:31:41 user nova-compute[75255]:   <devices>
Nov 14 11:31:41 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:31:41 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:31:41 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk"/>
Nov 14 11:31:41 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:31:41 user nova-compute[75255]:     </disk>
Nov 14 11:31:41 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:31:41 user nova-compute[75255]:       <mac address="fa:16:3e:f0:93:f2"/>
Nov 14 11:31:41 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:31:41 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:31:41 user nova-compute[75255]:       <target dev="tape39ee0d8-cb"/>
Nov 14 11:31:41 user nova-compute[75255]:     </interface>
Nov 14 11:31:41 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:31:41 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/console.log" append="off"/>
Nov 14 11:31:41 user nova-compute[75255]:     </serial>
Nov 14 11:31:41 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:31:41 user nova-compute[75255]:     <video>
Nov 14 11:31:41 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:31:41 user nova-compute[75255]:     </video>
Nov 14 11:31:41 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:31:41 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:31:41 user nova-compute[75255]:     </rng>
Nov 14 11:31:41 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:31:41 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:31:41 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:31:41 user nova-compute[75255]:     </memballoon>
Nov 14 11:31:41 user nova-compute[75255]:   </devices>
Nov 14 11:31:41 user nova-compute[75255]: </domain>
Nov 14 11:31:41 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671095676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671095676',id=40,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEZcydkis+nH8CQnz/LYXSN9dvLCB+pcr0dr8cD7m7ye5Orf8bOOSZGeYsILUEiXIcPpGZieKtNVBn5VN0xDrk0UgY4kzTDulN239RlNgWWCu0p30El9KShBCOmZlhPdQ==',key_name='tempest-keypair-2111564517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-bvowop90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=4d79ec1c-ad29-4b5f-a5d0-2993d70b2639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG os_vif [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89b05aff-8ff4-5c7c-ac66-031efd2ab456', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape39ee0d8-cb, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape39ee0d8-cb, col_values=(('qos', UUID('2fe1ae51-175f-427e-8d8f-1e02fa266bf3')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape39ee0d8-cb, col_values=(('external_ids', {'iface-id': 'e39ee0d8-cb8e-4456-806d-6b0935f109e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:93:f2', 'vm-uuid': '4d79ec1c-ad29-4b5f-a5d0-2993d70b2639'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:41 user nova-compute[75255]: INFO os_vif [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb')
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No VIF found with MAC fa:16:3e:f0:93:f2, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.neutron [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updated VIF entry in instance network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG nova.network.neutron [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:31:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-090b19eb-2eda-4a75-84b1-7a59348142d4 req-b7ebe126-8cec-4de1-b51e-e7d8ab9666f6 service nova] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:31:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-5b4fd61b-2cce-4904-b1ed-8007f42b0f68 req-9d7b16d0-88fe-4654-b281-37021680bc52 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5b4fd61b-2cce-4904-b1ed-8007f42b0f68 req-9d7b16d0-88fe-4654-b281-37021680bc52 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5b4fd61b-2cce-4904-b1ed-8007f42b0f68 req-9d7b16d0-88fe-4654-b281-37021680bc52 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5b4fd61b-2cce-4904-b1ed-8007f42b0f68 req-9d7b16d0-88fe-4654-b281-37021680bc52 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG nova.compute.manager [req-5b4fd61b-2cce-4904-b1ed-8007f42b0f68 req-9d7b16d0-88fe-4654-b281-37021680bc52 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:31:43 user nova-compute[75255]: WARNING nova.compute.manager [req-5b4fd61b-2cce-4904-b1ed-8007f42b0f68 req-9d7b16d0-88fe-4654-b281-37021680bc52 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state building and task_state spawning.
Nov 14 11:31:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:31:44 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance spawned successfully.
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:31:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:45 user nova-compute[75255]: INFO nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 11:31:45 user nova-compute[75255]: DEBUG nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:31:45 user nova-compute[75255]: INFO nova.compute.manager [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Took 6.04 seconds to build instance.
Nov 14 11:31:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-eabc6c4d-547c-4ea8-8421-08a873e414e2 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.134s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-545163c0-a481-4db3-ba5b-feb3d9a29dc5 req-bca26de5-f854-405f-8834-66b6f3f2c2e7 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-545163c0-a481-4db3-ba5b-feb3d9a29dc5 req-bca26de5-f854-405f-8834-66b6f3f2c2e7 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-545163c0-a481-4db3-ba5b-feb3d9a29dc5 req-bca26de5-f854-405f-8834-66b6f3f2c2e7 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-545163c0-a481-4db3-ba5b-feb3d9a29dc5 req-bca26de5-f854-405f-8834-66b6f3f2c2e7 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:45 user nova-compute[75255]: DEBUG nova.compute.manager [req-545163c0-a481-4db3-ba5b-feb3d9a29dc5 req-bca26de5-f854-405f-8834-66b6f3f2c2e7 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:31:45 user nova-compute[75255]: WARNING nova.compute.manager [req-545163c0-a481-4db3-ba5b-feb3d9a29dc5 req-bca26de5-f854-405f-8834-66b6f3f2c2e7 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state active and task_state None.
Nov 14 11:31:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:47 user nova-compute[75255]: INFO nova.compute.manager [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Terminating instance
Nov 14 11:31:47 user nova-compute[75255]: DEBUG nova.compute.manager [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-35b3e0c6-376b-4f04-b704-ade32bfeb729 req-83660747-22d4-4c46-9448-5954136a4548 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-vif-unplugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-35b3e0c6-376b-4f04-b704-ade32bfeb729 req-83660747-22d4-4c46-9448-5954136a4548 service nova] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-35b3e0c6-376b-4f04-b704-ade32bfeb729 req-83660747-22d4-4c46-9448-5954136a4548 service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-35b3e0c6-376b-4f04-b704-ade32bfeb729 req-83660747-22d4-4c46-9448-5954136a4548 service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-35b3e0c6-376b-4f04-b704-ade32bfeb729 req-83660747-22d4-4c46-9448-5954136a4548 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] No waiting events found dispatching network-vif-unplugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:31:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-35b3e0c6-376b-4f04-b704-ade32bfeb729 req-83660747-22d4-4c46-9448-5954136a4548 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-vif-unplugged-025100a4-a2e8-44f9-8527-ffb21667e406 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:31:48 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Instance destroyed successfully.
Nov 14 11:31:48 user nova-compute[75255]: DEBUG nova.objects.instance [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lazy-loading 'resources' on Instance uuid b8825fce-bc47-40b6-818d-8dc4b4013a3e {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-936708891',display_name='tempest-TestServerVolumeAttachmentScenario-server-936708891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-936708891',id=38,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRPDADsP95mhbienZV5wgnu/NFjIlnaFo3OdaQRrtee/aXvG9SjQa4NUYbDHkudvKBUFLVSsGvfAnQLhwu3xHMNeDvzC0X5QZ2CCiepKqP6G1uwQlTCZ/mVX7J2Q6A2KA==',key_name='tempest-keypair-1300622259',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdf3d9268f65441895036512e1b5a98e',ramdisk_id='',reservation_id='r-kejniyp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-617126292',owner_user_name='tempest-TestServerVolumeAttachmentScenario-617126292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d57172d6d9ea4352a0de539b0f0ed256',uuid=b8825fce-bc47-40b6-818d-8dc4b4013a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Converting VIF {"id": "025100a4-a2e8-44f9-8527-ffb21667e406", "address": "fa:16:3e:70:e4:33", "network": {"id": "919ddde7-d42a-412b-8b91-c52015bd2da9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-867775981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf3d9268f65441895036512e1b5a98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025100a4-a2", "ovs_interfaceid": "025100a4-a2e8-44f9-8527-ffb21667e406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:e4:33,bridge_name='br-int',has_traffic_filtering=True,id=025100a4-a2e8-44f9-8527-ffb21667e406,network=Network(919ddde7-d42a-412b-8b91-c52015bd2da9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025100a4-a2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG os_vif [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:e4:33,bridge_name='br-int',has_traffic_filtering=True,id=025100a4-a2e8-44f9-8527-ffb21667e406,network=Network(919ddde7-d42a-412b-8b91-c52015bd2da9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025100a4-a2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap025100a4-a2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07814b60-e880-4377-8aa3-09d6727bea31) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:48 user nova-compute[75255]: INFO os_vif [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:e4:33,bridge_name='br-int',has_traffic_filtering=True,id=025100a4-a2e8-44f9-8527-ffb21667e406,network=Network(919ddde7-d42a-412b-8b91-c52015bd2da9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025100a4-a2')
Nov 14 11:31:48 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Deleting instance files /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e_del
Nov 14 11:31:48 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Deletion of /opt/stack/data/nova/instances/b8825fce-bc47-40b6-818d-8dc4b4013a3e_del complete
Nov 14 11:31:48 user nova-compute[75255]: INFO nova.compute.manager [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 11:31:48 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:31:48 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:49 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Took 1.06 seconds to deallocate network for instance.
Nov 14 11:31:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-852fc32c-012f-49f9-8dbe-0d8460118157 req-743d8472-a51f-40d5-bb32-665173b7d9e0 service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-vif-deleted-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-848dec92-ce02-418e-99e2-ada953b013d5 req-f9b6811d-9364-40c2-bbbd-85b36498043b service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received event network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-848dec92-ce02-418e-99e2-ada953b013d5 req-f9b6811d-9364-40c2-bbbd-85b36498043b service nova] Acquiring lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-848dec92-ce02-418e-99e2-ada953b013d5 req-f9b6811d-9364-40c2-bbbd-85b36498043b service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-848dec92-ce02-418e-99e2-ada953b013d5 req-f9b6811d-9364-40c2-bbbd-85b36498043b service nova] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG nova.compute.manager [req-848dec92-ce02-418e-99e2-ada953b013d5 req-f9b6811d-9364-40c2-bbbd-85b36498043b service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] No waiting events found dispatching network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:31:49 user nova-compute[75255]: WARNING nova.compute.manager [req-848dec92-ce02-418e-99e2-ada953b013d5 req-f9b6811d-9364-40c2-bbbd-85b36498043b service nova] [instance: b8825fce-bc47-40b6-818d-8dc4b4013a3e] Received unexpected event network-vif-plugged-025100a4-a2e8-44f9-8527-ffb21667e406 for instance with vm_state deleted and task_state None.
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:49 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Deleted allocations for instance b8825fce-bc47-40b6-818d-8dc4b4013a3e
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-01d58ad0-64ef-4976-a2f9-6564edd116e5 tempest-TestServerVolumeAttachmentScenario-617126292 tempest-TestServerVolumeAttachmentScenario-617126292-project-member] Lock "b8825fce-bc47-40b6-818d-8dc4b4013a3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:31:50 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:31:50 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:31:50 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.054000854492188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance e574025a-2522-4796-8cdb-336bf8e14cd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:31:50 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:31:51 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:31:51 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:31:51 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:31:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:31:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:55 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:31:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:31:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:31:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:31:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:31:55 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:31:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating instance_info_cache with network_info: [{"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:31:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:31:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:31:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:31:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:31:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-changed-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG nova.compute.manager [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Refreshing instance network info cache due to event network-changed-fe5a2cb3-7102-4441-8906-cba971adb014. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] Acquiring lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] Acquired lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG nova.network.neutron [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Refreshing network info cache for port fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:00 user nova-compute[75255]: INFO nova.compute.manager [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Terminating instance
Nov 14 11:32:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:32:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updated VIF entry in instance network info cache for port fe5a2cb3-7102-4441-8906-cba971adb014. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.network.neutron [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updating instance_info_cache with network_info: [{"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9c824dd0-ddc6-48f5-ad21-1552436a3079 req-ba2348c0-539f-42fe-9ebf-e9fb14cace8d service nova] Releasing lock "refresh_cache-e574025a-2522-4796-8cdb-336bf8e14cd3" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:32:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Instance destroyed successfully.
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'resources' on Instance uuid e574025a-2522-4796-8cdb-336bf8e14cd3 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-531815042',display_name='tempest-TestStampPattern-server-531815042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-531815042',id=39,image_ref='66995d93-4111-4a4d-94bf-e15b4f3a2e58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+K+knKpNyZnoq/fwoIWr7QItDZQ5aLjEM7xC051cHvbV98q9oTME1VV23X8TxAqVI6fYWttj3e2KZ5Vhxbye8R2SGnCj7WIl6zRE+W17wWjn1nejVZq2nLaP4MQnIrw==',key_name='tempest-TestStampPattern-1486227609',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:29:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9282a36a740403f8a65ede3b9405d22',ramdisk_id='',reservation_id='r-53yuxceg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a',image_min_disk='1',image_min_ram='0',image_owner_id='c9282a36a740403f8a65ede3b9405d22',image_owner_project_name='tempest-TestStampPattern-761473602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-761473602-project-member',image_user_id='a4e5f5081c1b4691a79b2839bfc8c124',owner_project_name='tempest-TestStampPattern-761473602',owner_user_name='tempest-TestStampPattern-761473602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:29:17Z,user_data=None,user_id='a4e5f5081c1b4691a79b2839bfc8c124',uuid=e574025a-2522-4796-8cdb-336bf8e14cd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converting VIF {"id": "fe5a2cb3-7102-4441-8906-cba971adb014", "address": "fa:16:3e:78:af:a9", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5a2cb3-71", "ovs_interfaceid": "fe5a2cb3-7102-4441-8906-cba971adb014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:af:a9,bridge_name='br-int',has_traffic_filtering=True,id=fe5a2cb3-7102-4441-8906-cba971adb014,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5a2cb3-71') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG os_vif [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:af:a9,bridge_name='br-int',has_traffic_filtering=True,id=fe5a2cb3-7102-4441-8906-cba971adb014,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5a2cb3-71') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe5a2cb3-71, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9eb192a6-9858-4039-bd67-b078ab6952fa) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:32:01 user nova-compute[75255]: INFO os_vif [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:af:a9,bridge_name='br-int',has_traffic_filtering=True,id=fe5a2cb3-7102-4441-8906-cba971adb014,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5a2cb3-71')
Nov 14 11:32:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Deleting instance files /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3_del
Nov 14 11:32:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Deletion of /opt/stack/data/nova/instances/e574025a-2522-4796-8cdb-336bf8e14cd3_del complete
Nov 14 11:32:01 user nova-compute[75255]: INFO nova.compute.manager [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 11:32:01 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:32:01 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:02 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Took 0.56 seconds to deallocate network for instance.
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-9c5b85fe-8441-4d52-9776-c5d6c2df3994 req-261b7469-e909-47a2-9fc5-743d132f38b4 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-vif-deleted-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:02 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Deleted allocations for instance e574025a-2522-4796-8cdb-336bf8e14cd3
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-vif-unplugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] No waiting events found dispatching network-vif-unplugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:02 user nova-compute[75255]: WARNING nova.compute.manager [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received unexpected event network-vif-unplugged-fe5a2cb3-7102-4441-8906-cba971adb014 for instance with vm_state deleted and task_state None.
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received event network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] Acquiring lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] No waiting events found dispatching network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:02 user nova-compute[75255]: WARNING nova.compute.manager [req-a9229669-e445-44ca-aab0-a8bff381deec req-59d866ab-1677-4b88-9e29-a3ed60bd5361 service nova] [instance: e574025a-2522-4796-8cdb-336bf8e14cd3] Received unexpected event network-vif-plugged-fe5a2cb3-7102-4441-8906-cba971adb014 for instance with vm_state deleted and task_state None.
Nov 14 11:32:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-0ca4d290-640a-4337-b7f7-c299184283ff tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "e574025a-2522-4796-8cdb-336bf8e14cd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "1083ad03-03f0-4909-b588-c7133d8da973" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:32:11 user nova-compute[75255]: INFO nova.compute.claims [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Claim successful on node user
Nov 14 11:32:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:32:11 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:32:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.policy [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2abf6da5049d4bc2a677ffa7d6cee58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242dd529d2bc43f1bcc1e2feae480b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:32:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Creating image(s)
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "/opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "/opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "/opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.227s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk 1073741824" returned: 0 in 0.074s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Successfully created port: 872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:32:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Cannot resize image /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Ensure instance console log exists: /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Successfully updated port: 872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquired lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received event network-changed-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Refreshing instance network info cache due to event network-changed-872e9c09-db9a-46ea-8152-4f135f9e8f02. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] Acquiring lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updating instance_info_cache with network_info: [{"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Releasing lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Instance network_info: |[{"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] Acquired lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.neutron [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Refreshing network info cache for port 872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Start _get_guest_xml network_info=[{"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:32:13 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:32:13 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1948448393',display_name='tempest-ServersNegativeTestJSON-server-1948448393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1948448393',id=41,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242dd529d2bc43f1bcc1e2feae480b64',ramdisk_id='',reservation_id='r-fkwydm9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1020604939',owner_user_name='tempest-ServersNegativeTestJSON-1020604939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:32:12Z,user_data=None,user_id='2abf6da5049d4bc2a677ffa7d6cee58a',uuid=1083ad03-03f0-4909-b588-c7133d8da973,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converting VIF {"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=872e9c09-db9a-46ea-8152-4f135f9e8f02,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872e9c09-db') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lazy-loading 'pci_devices' on Instance uuid 1083ad03-03f0-4909-b588-c7133d8da973 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:32:13 user nova-compute[75255]:   <uuid>1083ad03-03f0-4909-b588-c7133d8da973</uuid>
Nov 14 11:32:13 user nova-compute[75255]:   <name>instance-00000029</name>
Nov 14 11:32:13 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:32:13 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:32:13 user nova-compute[75255]:   <metadata>
Nov 14 11:32:13 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:32:13 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:32:13 user nova-compute[75255]:       <nova:name>tempest-ServersNegativeTestJSON-server-1948448393</nova:name>
Nov 14 11:32:13 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:32:13</nova:creationTime>
Nov 14 11:32:13 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:32:13 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:32:13 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:32:13 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:32:13 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:32:13 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:32:13 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:32:13 user nova-compute[75255]:       <nova:owner>
Nov 14 11:32:13 user nova-compute[75255]:         <nova:user uuid="2abf6da5049d4bc2a677ffa7d6cee58a">tempest-ServersNegativeTestJSON-1020604939-project-member</nova:user>
Nov 14 11:32:13 user nova-compute[75255]:         <nova:project uuid="242dd529d2bc43f1bcc1e2feae480b64">tempest-ServersNegativeTestJSON-1020604939</nova:project>
Nov 14 11:32:13 user nova-compute[75255]:       </nova:owner>
Nov 14 11:32:13 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:32:13 user nova-compute[75255]:       <nova:ports>
Nov 14 11:32:13 user nova-compute[75255]:         <nova:port uuid="872e9c09-db9a-46ea-8152-4f135f9e8f02">
Nov 14 11:32:13 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:32:13 user nova-compute[75255]:         </nova:port>
Nov 14 11:32:13 user nova-compute[75255]:       </nova:ports>
Nov 14 11:32:13 user nova-compute[75255]:     </nova:instance>
Nov 14 11:32:13 user nova-compute[75255]:   </metadata>
Nov 14 11:32:13 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:32:13 user nova-compute[75255]:     <system>
Nov 14 11:32:13 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:32:13 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:32:13 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:32:13 user nova-compute[75255]:       <entry name="serial">1083ad03-03f0-4909-b588-c7133d8da973</entry>
Nov 14 11:32:13 user nova-compute[75255]:       <entry name="uuid">1083ad03-03f0-4909-b588-c7133d8da973</entry>
Nov 14 11:32:13 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:32:13 user nova-compute[75255]:     </system>
Nov 14 11:32:13 user nova-compute[75255]:   </sysinfo>
Nov 14 11:32:13 user nova-compute[75255]:   <os>
Nov 14 11:32:13 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:32:13 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:32:13 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:32:13 user nova-compute[75255]:   </os>
Nov 14 11:32:13 user nova-compute[75255]:   <features>
Nov 14 11:32:13 user nova-compute[75255]:     <acpi/>
Nov 14 11:32:13 user nova-compute[75255]:     <apic/>
Nov 14 11:32:13 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:32:13 user nova-compute[75255]:   </features>
Nov 14 11:32:13 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:32:13 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:32:13 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:32:13 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:32:13 user nova-compute[75255]:   </clock>
Nov 14 11:32:13 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:32:13 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:32:13 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:32:13 user nova-compute[75255]:   </cpu>
Nov 14 11:32:13 user nova-compute[75255]:   <devices>
Nov 14 11:32:13 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:32:13 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:32:13 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk"/>
Nov 14 11:32:13 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:32:13 user nova-compute[75255]:     </disk>
Nov 14 11:32:13 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:32:13 user nova-compute[75255]:       <mac address="fa:16:3e:b9:1f:ff"/>
Nov 14 11:32:13 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:32:13 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:32:13 user nova-compute[75255]:       <target dev="tap872e9c09-db"/>
Nov 14 11:32:13 user nova-compute[75255]:     </interface>
Nov 14 11:32:13 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:32:13 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/console.log" append="off"/>
Nov 14 11:32:13 user nova-compute[75255]:     </serial>
Nov 14 11:32:13 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:32:13 user nova-compute[75255]:     <video>
Nov 14 11:32:13 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:32:13 user nova-compute[75255]:     </video>
Nov 14 11:32:13 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:32:13 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:32:13 user nova-compute[75255]:     </rng>
Nov 14 11:32:13 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:32:13 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:32:13 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:32:13 user nova-compute[75255]:     </memballoon>
Nov 14 11:32:13 user nova-compute[75255]:   </devices>
Nov 14 11:32:13 user nova-compute[75255]: </domain>
Nov 14 11:32:13 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1948448393',display_name='tempest-ServersNegativeTestJSON-server-1948448393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1948448393',id=41,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242dd529d2bc43f1bcc1e2feae480b64',ramdisk_id='',reservation_id='r-fkwydm9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1020604939',owner_user_name='tempest-ServersNegativeTestJSON-1020604939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:32:12Z,user_data=None,user_id='2abf6da5049d4bc2a677ffa7d6cee58a',uuid=1083ad03-03f0-4909-b588-c7133d8da973,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converting VIF {"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=872e9c09-db9a-46ea-8152-4f135f9e8f02,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872e9c09-db') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG os_vif [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=872e9c09-db9a-46ea-8152-4f135f9e8f02,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872e9c09-db') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2000723e-5fc2-5684-a8ef-0729368d8926', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap872e9c09-db, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap872e9c09-db, col_values=(('qos', UUID('1609059e-6936-4226-b0d3-7292e06f5a84')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap872e9c09-db, col_values=(('external_ids', {'iface-id': '872e9c09-db9a-46ea-8152-4f135f9e8f02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:1f:ff', 'vm-uuid': '1083ad03-03f0-4909-b588-c7133d8da973'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:13 user nova-compute[75255]: INFO os_vif [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=872e9c09-db9a-46ea-8152-4f135f9e8f02,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872e9c09-db')
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:32:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] No VIF found with MAC fa:16:3e:b9:1f:ff, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:32:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updated VIF entry in instance network info cache for port 872e9c09-db9a-46ea-8152-4f135f9e8f02. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:32:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updating instance_info_cache with network_info: [{"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1d5f6c6a-c888-4b13-83f5-2dc9199a621b req-877b35c8-e781-490f-9627-27242756a85e service nova] Releasing lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:32:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-22fa1737-9fdc-4b3c-a8ce-d2aed7be33ec req-f02099d4-315c-4906-b992-0a7fab66d499 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received event network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-22fa1737-9fdc-4b3c-a8ce-d2aed7be33ec req-f02099d4-315c-4906-b992-0a7fab66d499 service nova] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-22fa1737-9fdc-4b3c-a8ce-d2aed7be33ec req-f02099d4-315c-4906-b992-0a7fab66d499 service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-22fa1737-9fdc-4b3c-a8ce-d2aed7be33ec req-f02099d4-315c-4906-b992-0a7fab66d499 service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-22fa1737-9fdc-4b3c-a8ce-d2aed7be33ec req-f02099d4-315c-4906-b992-0a7fab66d499 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] No waiting events found dispatching network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:16 user nova-compute[75255]: WARNING nova.compute.manager [req-22fa1737-9fdc-4b3c-a8ce-d2aed7be33ec req-f02099d4-315c-4906-b992-0a7fab66d499 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received unexpected event network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 for instance with vm_state building and task_state spawning.
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:32:17 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Instance spawned successfully.
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:17 user nova-compute[75255]: INFO nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:32:17 user nova-compute[75255]: INFO nova.compute.manager [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Took 5.80 seconds to build instance.
Nov 14 11:32:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-3efb4440-6b2c-420b-ac57-33fe972d611d tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "1083ad03-03f0-4909-b588-c7133d8da973" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.938s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:32:18 user nova-compute[75255]: INFO nova.compute.claims [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Claim successful on node user
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-839ae4d0-e28b-462d-8803-6d27bd5167d8 req-f73afb2b-0dfb-4307-bf6d-1f3c8730730b service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received event network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-839ae4d0-e28b-462d-8803-6d27bd5167d8 req-f73afb2b-0dfb-4307-bf6d-1f3c8730730b service nova] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-839ae4d0-e28b-462d-8803-6d27bd5167d8 req-f73afb2b-0dfb-4307-bf6d-1f3c8730730b service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-839ae4d0-e28b-462d-8803-6d27bd5167d8 req-f73afb2b-0dfb-4307-bf6d-1f3c8730730b service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-839ae4d0-e28b-462d-8803-6d27bd5167d8 req-f73afb2b-0dfb-4307-bf6d-1f3c8730730b service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] No waiting events found dispatching network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:18 user nova-compute[75255]: WARNING nova.compute.manager [req-839ae4d0-e28b-462d-8803-6d27bd5167d8 req-f73afb2b-0dfb-4307-bf6d-1f3c8730730b service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received unexpected event network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 for instance with vm_state active and task_state None.
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:32:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.policy [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0cf05034c9c4fa4bf29de247f874f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5712609da01d48709e1dbb3dc1ad940f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:32:18 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Creating image(s)
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "/opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "/opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "/opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk 1073741824" returned: 0 in 0.048s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Successfully created port: 2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Cannot resize image /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Ensure instance console log exists: /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Successfully updated port: 2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquired lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.network.neutron [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating instance_info_cache with network_info: [{"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Releasing lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Instance network_info: |[{"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:32:19 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Start _get_guest_xml network_info=[{"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:32:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:32:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1173906203',display_name='tempest-SnapshotDataIntegrityTests-server-1173906203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1173906203',id=42,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdUVRT3HuDepm/kPTgRJdPhOumLF2DKwWP+KBBalgj0Etvx5Dkf72d5F6hEY0CszuXwsrvnqYlNeEiSouFtbC8Y9vvuXjNGxnV6/YXrxAnPGJZEbkM40Lp4DkWgUscNYw==',key_name='tempest-keypair-136710357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5712609da01d48709e1dbb3dc1ad940f',ramdisk_id='',reservation_id='r-28mr8u5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1849024285',owner_user_name='tempest-SnapshotDataIntegrityTests-1849024285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0cf05034c9c4fa4bf29de247f874f0b',uuid=5900f8a3-9336-4788-82d7-a30270bbb218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Converting VIF {"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:af:33,bridge_name='br-int',has_traffic_filtering=True,id=2a3d5b29-9478-4a00-bbab-c2db14e1ec5b,network=Network(9cf0c8c4-d97a-4522-b8e8-171dea409068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3d5b29-94') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'pci_devices' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:32:20 user nova-compute[75255]:   <uuid>5900f8a3-9336-4788-82d7-a30270bbb218</uuid>
Nov 14 11:32:20 user nova-compute[75255]:   <name>instance-0000002a</name>
Nov 14 11:32:20 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:32:20 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:32:20 user nova-compute[75255]:   <metadata>
Nov 14 11:32:20 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:32:20 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:32:20 user nova-compute[75255]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1173906203</nova:name>
Nov 14 11:32:20 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:32:20</nova:creationTime>
Nov 14 11:32:20 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:32:20 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:32:20 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:32:20 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:32:20 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:32:20 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:32:20 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:32:20 user nova-compute[75255]:       <nova:owner>
Nov 14 11:32:20 user nova-compute[75255]:         <nova:user uuid="e0cf05034c9c4fa4bf29de247f874f0b">tempest-SnapshotDataIntegrityTests-1849024285-project-member</nova:user>
Nov 14 11:32:20 user nova-compute[75255]:         <nova:project uuid="5712609da01d48709e1dbb3dc1ad940f">tempest-SnapshotDataIntegrityTests-1849024285</nova:project>
Nov 14 11:32:20 user nova-compute[75255]:       </nova:owner>
Nov 14 11:32:20 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:32:20 user nova-compute[75255]:       <nova:ports>
Nov 14 11:32:20 user nova-compute[75255]:         <nova:port uuid="2a3d5b29-9478-4a00-bbab-c2db14e1ec5b">
Nov 14 11:32:20 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 11:32:20 user nova-compute[75255]:         </nova:port>
Nov 14 11:32:20 user nova-compute[75255]:       </nova:ports>
Nov 14 11:32:20 user nova-compute[75255]:     </nova:instance>
Nov 14 11:32:20 user nova-compute[75255]:   </metadata>
Nov 14 11:32:20 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:32:20 user nova-compute[75255]:     <system>
Nov 14 11:32:20 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:32:20 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:32:20 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:32:20 user nova-compute[75255]:       <entry name="serial">5900f8a3-9336-4788-82d7-a30270bbb218</entry>
Nov 14 11:32:20 user nova-compute[75255]:       <entry name="uuid">5900f8a3-9336-4788-82d7-a30270bbb218</entry>
Nov 14 11:32:20 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:32:20 user nova-compute[75255]:     </system>
Nov 14 11:32:20 user nova-compute[75255]:   </sysinfo>
Nov 14 11:32:20 user nova-compute[75255]:   <os>
Nov 14 11:32:20 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:32:20 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:32:20 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:32:20 user nova-compute[75255]:   </os>
Nov 14 11:32:20 user nova-compute[75255]:   <features>
Nov 14 11:32:20 user nova-compute[75255]:     <acpi/>
Nov 14 11:32:20 user nova-compute[75255]:     <apic/>
Nov 14 11:32:20 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:32:20 user nova-compute[75255]:   </features>
Nov 14 11:32:20 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:32:20 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:32:20 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:32:20 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:32:20 user nova-compute[75255]:   </clock>
Nov 14 11:32:20 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:32:20 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:32:20 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:32:20 user nova-compute[75255]:   </cpu>
Nov 14 11:32:20 user nova-compute[75255]:   <devices>
Nov 14 11:32:20 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:32:20 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:32:20 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk"/>
Nov 14 11:32:20 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:32:20 user nova-compute[75255]:     </disk>
Nov 14 11:32:20 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:32:20 user nova-compute[75255]:       <mac address="fa:16:3e:87:af:33"/>
Nov 14 11:32:20 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:32:20 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:32:20 user nova-compute[75255]:       <target dev="tap2a3d5b29-94"/>
Nov 14 11:32:20 user nova-compute[75255]:     </interface>
Nov 14 11:32:20 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:32:20 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/console.log" append="off"/>
Nov 14 11:32:20 user nova-compute[75255]:     </serial>
Nov 14 11:32:20 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:32:20 user nova-compute[75255]:     <video>
Nov 14 11:32:20 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:32:20 user nova-compute[75255]:     </video>
Nov 14 11:32:20 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:32:20 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:32:20 user nova-compute[75255]:     </rng>
Nov 14 11:32:20 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:32:20 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:32:20 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:32:20 user nova-compute[75255]:     </memballoon>
Nov 14 11:32:20 user nova-compute[75255]:   </devices>
Nov 14 11:32:20 user nova-compute[75255]: </domain>
Nov 14 11:32:20 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1173906203',display_name='tempest-SnapshotDataIntegrityTests-server-1173906203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1173906203',id=42,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdUVRT3HuDepm/kPTgRJdPhOumLF2DKwWP+KBBalgj0Etvx5Dkf72d5F6hEY0CszuXwsrvnqYlNeEiSouFtbC8Y9vvuXjNGxnV6/YXrxAnPGJZEbkM40Lp4DkWgUscNYw==',key_name='tempest-keypair-136710357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5712609da01d48709e1dbb3dc1ad940f',ramdisk_id='',reservation_id='r-28mr8u5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1849024285',owner_user_name='tempest-SnapshotDataIntegrityTests-1849024285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0cf05034c9c4fa4bf29de247f874f0b',uuid=5900f8a3-9336-4788-82d7-a30270bbb218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Converting VIF {"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:af:33,bridge_name='br-int',has_traffic_filtering=True,id=2a3d5b29-9478-4a00-bbab-c2db14e1ec5b,network=Network(9cf0c8c4-d97a-4522-b8e8-171dea409068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3d5b29-94') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG os_vif [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:af:33,bridge_name='br-int',has_traffic_filtering=True,id=2a3d5b29-9478-4a00-bbab-c2db14e1ec5b,network=Network(9cf0c8c4-d97a-4522-b8e8-171dea409068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3d5b29-94') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '655d9f7a-6a9c-52a2-98d6-917e5ec432ae', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a3d5b29-94, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a3d5b29-94, col_values=(('qos', UUID('a6d96197-aa37-4bb8-a17d-a74cce72c4a7')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a3d5b29-94, col_values=(('external_ids', {'iface-id': '2a3d5b29-9478-4a00-bbab-c2db14e1ec5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:af:33', 'vm-uuid': '5900f8a3-9336-4788-82d7-a30270bbb218'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:20 user nova-compute[75255]: INFO os_vif [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:af:33,bridge_name='br-int',has_traffic_filtering=True,id=2a3d5b29-9478-4a00-bbab-c2db14e1ec5b,network=Network(9cf0c8c4-d97a-4522-b8e8-171dea409068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3d5b29-94')
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-changed-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Refreshing instance network info cache due to event network-changed-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] Acquiring lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] Acquired lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.network.neutron [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Refreshing network info cache for port 2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No VIF found with MAC fa:16:3e:87:af:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.network.neutron [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updated VIF entry in instance network info cache for port 2a3d5b29-9478-4a00-bbab-c2db14e1ec5b. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG nova.network.neutron [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating instance_info_cache with network_info: [{"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b6e4de85-8a01-4167-8d9c-1cb72a181752 req-799f5e40-a1bd-42aa-af59-569bb0b0e0bc service nova] Releasing lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:32:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] No waiting events found dispatching network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:22 user nova-compute[75255]: WARNING nova.compute.manager [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received unexpected event network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b for instance with vm_state building and task_state spawning.
Nov 14 11:32:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] No waiting events found dispatching network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:22 user nova-compute[75255]: WARNING nova.compute.manager [req-08bf8ca8-ad88-47e0-91f9-425c106bace1 req-74f5c188-f389-4ba0-8c38-545765d22342 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received unexpected event network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b for instance with vm_state building and task_state spawning.
Nov 14 11:32:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:32:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:32:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Instance spawned successfully.
Nov 14 11:32:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:32:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:32:24 user nova-compute[75255]: INFO nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 14 11:32:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:32:24 user nova-compute[75255]: INFO nova.compute.manager [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Took 6.15 seconds to build instance.
Nov 14 11:32:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7205a6b1-403a-432e-88a0-77a295d09426 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.271s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:49 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:32:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:50 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:32:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:32:53 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:32:53 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8503MB free_disk=24.966331481933594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5900f8a3-9336-4788-82d7-a30270bbb218 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:32:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:54 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:54 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:32:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:32:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:32:54 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:32:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-changed-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Refreshing instance network info cache due to event network-changed-3df945d4-067c-4ff3-812d-f020c97468f9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] Acquiring lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] Acquired lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:32:55 user nova-compute[75255]: DEBUG nova.network.neutron [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Refreshing network info cache for port 3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:32:56 user nova-compute[75255]: INFO nova.compute.manager [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Terminating instance
Nov 14 11:32:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updated VIF entry in instance network info cache for port 3df945d4-067c-4ff3-812d-f020c97468f9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating instance_info_cache with network_info: [{"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0094014b-4cb6-4e1f-83fa-f9dd41f2b402 req-f632224c-81ab-4109-aa07-d27e0daf30fb service nova] Releasing lock "refresh_cache-d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:32:56 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Instance destroyed successfully.
Nov 14 11:32:56 user nova-compute[75255]: DEBUG nova.objects.instance [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lazy-loading 'resources' on Instance uuid d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-669989355',display_name='tempest-TestStampPattern-server-669989355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-669989355',id=37,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+K+knKpNyZnoq/fwoIWr7QItDZQ5aLjEM7xC051cHvbV98q9oTME1VV23X8TxAqVI6fYWttj3e2KZ5Vhxbye8R2SGnCj7WIl6zRE+W17wWjn1nejVZq2nLaP4MQnIrw==',key_name='tempest-TestStampPattern-1486227609',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9282a36a740403f8a65ede3b9405d22',ramdisk_id='',reservation_id='r-igsacede',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-761473602',owner_user_name='tempest-TestStampPattern-761473602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:29:08Z,user_data=None,user_id='a4e5f5081c1b4691a79b2839bfc8c124',uuid=d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converting VIF {"id": "3df945d4-067c-4ff3-812d-f020c97468f9", "address": "fa:16:3e:c2:97:b1", "network": {"id": "650dfe7c-5bdd-4ddb-b969-028542ac5878", "bridge": "br-int", "label": "tempest-TestStampPattern-851017170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9282a36a740403f8a65ede3b9405d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df945d4-06", "ovs_interfaceid": "3df945d4-067c-4ff3-812d-f020c97468f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=3df945d4-067c-4ff3-812d-f020c97468f9,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df945d4-06') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG os_vif [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=3df945d4-067c-4ff3-812d-f020c97468f9,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df945d4-06') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3df945d4-06, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c43c1dc9-6b3a-490d-9e98-c9bda3223daf) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:32:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:32:56 user nova-compute[75255]: INFO os_vif [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=3df945d4-067c-4ff3-812d-f020c97468f9,network=Network(650dfe7c-5bdd-4ddb-b969-028542ac5878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df945d4-06')
Nov 14 11:32:56 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Deleting instance files /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a_del
Nov 14 11:32:56 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Deletion of /opt/stack/data/nova/instances/d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a_del complete
Nov 14 11:32:57 user nova-compute[75255]: INFO nova.compute.manager [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-e71ba3fe-2c17-4af2-9acf-b3ba62912f02 req-43cfa852-7603-4416-9454-7c9472c143ef service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-vif-deleted-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:57 user nova-compute[75255]: INFO nova.compute.manager [req-e71ba3fe-2c17-4af2-9acf-b3ba62912f02 req-43cfa852-7603-4416-9454-7c9472c143ef service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Neutron deleted interface 3df945d4-067c-4ff3-812d-f020c97468f9; detaching it from the instance and deleting it from the info cache
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.network.neutron [req-e71ba3fe-2c17-4af2-9acf-b3ba62912f02 req-43cfa852-7603-4416-9454-7c9472c143ef service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:32:57 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Took 0.46 seconds to deallocate network for instance.
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-e71ba3fe-2c17-4af2-9acf-b3ba62912f02 req-43cfa852-7603-4416-9454-7c9472c143ef service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Detach interface failed, port_id=3df945d4-067c-4ff3-812d-f020c97468f9, reason: Instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:57 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Deleted allocations for instance d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-vif-unplugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] No waiting events found dispatching network-vif-unplugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:57 user nova-compute[75255]: WARNING nova.compute.manager [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received unexpected event network-vif-unplugged-3df945d4-067c-4ff3-812d-f020c97468f9 for instance with vm_state deleted and task_state None.
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received event network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] Acquiring lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:32:57 user nova-compute[75255]: DEBUG nova.compute.manager [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] No waiting events found dispatching network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:32:57 user nova-compute[75255]: WARNING nova.compute.manager [req-f08aeef9-a8d3-4a1b-ae28-d24ffb8b48cc req-fbbccdb3-ce34-45f5-bc47-5d754e7e41a8 service nova] [instance: d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a] Received unexpected event network-vif-plugged-3df945d4-067c-4ff3-812d-f020c97468f9 for instance with vm_state deleted and task_state None.
Nov 14 11:32:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-83bfd290-8d69-4221-8d8f-71db3906a887 tempest-TestStampPattern-761473602 tempest-TestStampPattern-761473602-project-member] Lock "d0aef4a6-0aea-4d6f-82e0-6e79abaeb79a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:33:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:33:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:33:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_power_states {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 1083ad03-03f0-4909-b588-c7133d8da973 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "1083ad03-03f0-4909-b588-c7133d8da973" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "1083ad03-03f0-4909-b588-c7133d8da973" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:33:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:33:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:33:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:33:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:33:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:33:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:33:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing instance network info cache due to event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:33:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:33:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:33:29 user nova-compute[75255]: DEBUG nova.network.neutron [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:33:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:30 user nova-compute[75255]: DEBUG nova.network.neutron [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updated VIF entry in instance network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:33:30 user nova-compute[75255]: DEBUG nova.network.neutron [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:33:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5dde40c3-3ca4-4640-9fb5-ead39576ae1b req-4107bd8d-671c-48c4-b8d5-039507ab0d79 service nova] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:33:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:32 user nova-compute[75255]: INFO nova.compute.manager [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Shelving
Nov 14 11:33:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-341e6e15-5b3e-4d8e-ad02-4e4319d7af91 req-7056b8f8-011b-46a0-87d4-cc9f0bec6618 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-341e6e15-5b3e-4d8e-ad02-4e4319d7af91 req-7056b8f8-011b-46a0-87d4-cc9f0bec6618 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-341e6e15-5b3e-4d8e-ad02-4e4319d7af91 req-7056b8f8-011b-46a0-87d4-cc9f0bec6618 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-341e6e15-5b3e-4d8e-ad02-4e4319d7af91 req-7056b8f8-011b-46a0-87d4-cc9f0bec6618 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-341e6e15-5b3e-4d8e-ad02-4e4319d7af91 req-7056b8f8-011b-46a0-87d4-cc9f0bec6618 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:33:32 user nova-compute[75255]: WARNING nova.compute.manager [req-341e6e15-5b3e-4d8e-ad02-4e4319d7af91 req-7056b8f8-011b-46a0-87d4-cc9f0bec6618 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state active and task_state shelving.
Nov 14 11:33:33 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance destroyed successfully.
Nov 14 11:33:33 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Beginning cold snapshot process
Nov 14 11:33:33 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:33:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk /opt/stack/data/nova/instances/snapshots/tmplu99le52/5e35ecf154094693a2eccb8812585217 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:33:34 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk /opt/stack/data/nova/instances/snapshots/tmplu99le52/5e35ecf154094693a2eccb8812585217" returned: 0 in 0.696s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:33:34 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Snapshot extracted, beginning image upload
Nov 14 11:33:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-efa2b76f-591e-45cb-bf96-8c09b48cad70 req-2f138cdf-3a96-45a5-8980-ef42e7371856 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:33:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-efa2b76f-591e-45cb-bf96-8c09b48cad70 req-2f138cdf-3a96-45a5-8980-ef42e7371856 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-efa2b76f-591e-45cb-bf96-8c09b48cad70 req-2f138cdf-3a96-45a5-8980-ef42e7371856 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-efa2b76f-591e-45cb-bf96-8c09b48cad70 req-2f138cdf-3a96-45a5-8980-ef42e7371856 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-efa2b76f-591e-45cb-bf96-8c09b48cad70 req-2f138cdf-3a96-45a5-8980-ef42e7371856 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:33:34 user nova-compute[75255]: WARNING nova.compute.manager [req-efa2b76f-591e-45cb-bf96-8c09b48cad70 req-2f138cdf-3a96-45a5-8980-ef42e7371856 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 11:33:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Snapshot image upload complete
Nov 14 11:33:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:33:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:36 user nova-compute[75255]: INFO nova.compute.manager [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Shelve offloading
Nov 14 11:33:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance destroyed successfully.
Nov 14 11:33:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:33:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:33:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:33:36 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:33:37 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance destroyed successfully.
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'resources' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671095676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671095676',id=40,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEZcydkis+nH8CQnz/LYXSN9dvLCB+pcr0dr8cD7m7ye5Orf8bOOSZGeYsILUEiXIcPpGZieKtNVBn5VN0xDrk0UgY4kzTDulN239RlNgWWCu0p30El9KShBCOmZlhPdQ==',key_name='tempest-keypair-2111564517',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-bvowop90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member',shelved_at='2023-11-14T11:33:36.794019',shelved_host='user',shelved_image_id='0cf37f07-1e91-4ab8-9db6-01a2e543b584'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=4d79ec1c-ad29-4b5f-a5d0-2993d70b2639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG os_vif [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape39ee0d8-cb, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fe1ae51-175f-427e-8d8f-1e02fa266bf3) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing instance network info cache due to event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.network.neutron [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:33:37 user nova-compute[75255]: INFO os_vif [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb')
Nov 14 11:33:37 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Deleting instance files /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639_del
Nov 14 11:33:37 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Deletion of /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639_del complete
Nov 14 11:33:37 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Deleted allocations for instance 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639
Nov 14 11:33:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:33:37 user nova-compute[75255]: DEBUG nova.objects.base [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<4d79ec1c-ad29-4b5f-a5d0-2993d70b2639> lazy-loaded attributes: resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:33:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:33:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:33:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e1daa5c0-7763-4c9e-9c82-05497f9e11ac tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.659s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:38 user nova-compute[75255]: DEBUG nova.network.neutron [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updated VIF entry in instance network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:33:38 user nova-compute[75255]: DEBUG nova.network.neutron [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:33:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-51e78cae-dd1e-4e39-a9dc-b134eeb7ff2e req-d70b7dd8-8e89-43d8-8959-8201f39462f6 service nova] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:33:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:41 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:51 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:33:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:52 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:33:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:33:54 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:33:54 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.06137466430664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5900f8a3-9336-4788-82d7-a30270bbb218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:33:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 1083ad03-03f0-4909-b588-c7133d8da973 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updating instance_info_cache with network_info: [{"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:33:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:33:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:34:03 user nova-compute[75255]: INFO nova.compute.claims [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Claim successful on node user
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.network.neutron [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:34:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.policy [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2abf6da5049d4bc2a677ffa7d6cee58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242dd529d2bc43f1bcc1e2feae480b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:34:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Creating image(s)
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "/opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "/opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk 1073741824" returned: 0 in 0.055s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Successfully created port: ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Cannot resize image /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Ensure instance console log exists: /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Successfully updated port: ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "refresh_cache-b9ac5751-d6fa-4136-9e02-c6856dfe5b98" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquired lock "refresh_cache-b9ac5751-d6fa-4136-9e02-c6856dfe5b98" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received event network-changed-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Refreshing instance network info cache due to event network-changed-ee1afda3-2a68-411d-8323-cfa4fad59b16. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] Acquiring lock "refresh_cache-b9ac5751-d6fa-4136-9e02-c6856dfe5b98" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:34:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Updating instance_info_cache with network_info: [{"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Releasing lock "refresh_cache-b9ac5751-d6fa-4136-9e02-c6856dfe5b98" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Instance network_info: |[{"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] Acquired lock "refresh_cache-b9ac5751-d6fa-4136-9e02-c6856dfe5b98" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Refreshing network info cache for port ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Start _get_guest_xml network_info=[{"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:34:05 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:34:05 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-743371484',display_name='tempest-ServersNegativeTestJSON-server-743371484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-743371484',id=43,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242dd529d2bc43f1bcc1e2feae480b64',ramdisk_id='',reservation_id='r-x2vpoc6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1020604939',owner_user_name='tempest-ServersNegativeTestJSON-1020604939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:34:03Z,user_data=None,user_id='2abf6da5049d4bc2a677ffa7d6cee58a',uuid=b9ac5751-d6fa-4136-9e02-c6856dfe5b98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converting VIF {"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d2:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee1afda3-2a68-411d-8323-cfa4fad59b16,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1afda3-2a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.objects.instance [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ac5751-d6fa-4136-9e02-c6856dfe5b98 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:34:05 user nova-compute[75255]:   <uuid>b9ac5751-d6fa-4136-9e02-c6856dfe5b98</uuid>
Nov 14 11:34:05 user nova-compute[75255]:   <name>instance-0000002b</name>
Nov 14 11:34:05 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:34:05 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:34:05 user nova-compute[75255]:   <metadata>
Nov 14 11:34:05 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:34:05 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:34:05 user nova-compute[75255]:       <nova:name>tempest-ServersNegativeTestJSON-server-743371484</nova:name>
Nov 14 11:34:05 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:34:05</nova:creationTime>
Nov 14 11:34:05 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:34:05 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:34:05 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:34:05 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:34:05 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:34:05 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:34:05 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:34:05 user nova-compute[75255]:       <nova:owner>
Nov 14 11:34:05 user nova-compute[75255]:         <nova:user uuid="2abf6da5049d4bc2a677ffa7d6cee58a">tempest-ServersNegativeTestJSON-1020604939-project-member</nova:user>
Nov 14 11:34:05 user nova-compute[75255]:         <nova:project uuid="242dd529d2bc43f1bcc1e2feae480b64">tempest-ServersNegativeTestJSON-1020604939</nova:project>
Nov 14 11:34:05 user nova-compute[75255]:       </nova:owner>
Nov 14 11:34:05 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:34:05 user nova-compute[75255]:       <nova:ports>
Nov 14 11:34:05 user nova-compute[75255]:         <nova:port uuid="ee1afda3-2a68-411d-8323-cfa4fad59b16">
Nov 14 11:34:05 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 11:34:05 user nova-compute[75255]:         </nova:port>
Nov 14 11:34:05 user nova-compute[75255]:       </nova:ports>
Nov 14 11:34:05 user nova-compute[75255]:     </nova:instance>
Nov 14 11:34:05 user nova-compute[75255]:   </metadata>
Nov 14 11:34:05 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:34:05 user nova-compute[75255]:     <system>
Nov 14 11:34:05 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:34:05 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:34:05 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:34:05 user nova-compute[75255]:       <entry name="serial">b9ac5751-d6fa-4136-9e02-c6856dfe5b98</entry>
Nov 14 11:34:05 user nova-compute[75255]:       <entry name="uuid">b9ac5751-d6fa-4136-9e02-c6856dfe5b98</entry>
Nov 14 11:34:05 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:34:05 user nova-compute[75255]:     </system>
Nov 14 11:34:05 user nova-compute[75255]:   </sysinfo>
Nov 14 11:34:05 user nova-compute[75255]:   <os>
Nov 14 11:34:05 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:34:05 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:34:05 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:34:05 user nova-compute[75255]:   </os>
Nov 14 11:34:05 user nova-compute[75255]:   <features>
Nov 14 11:34:05 user nova-compute[75255]:     <acpi/>
Nov 14 11:34:05 user nova-compute[75255]:     <apic/>
Nov 14 11:34:05 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:34:05 user nova-compute[75255]:   </features>
Nov 14 11:34:05 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:34:05 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:34:05 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:34:05 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:34:05 user nova-compute[75255]:   </clock>
Nov 14 11:34:05 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:34:05 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:34:05 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:34:05 user nova-compute[75255]:   </cpu>
Nov 14 11:34:05 user nova-compute[75255]:   <devices>
Nov 14 11:34:05 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:34:05 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:34:05 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk"/>
Nov 14 11:34:05 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:34:05 user nova-compute[75255]:     </disk>
Nov 14 11:34:05 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:34:05 user nova-compute[75255]:       <mac address="fa:16:3e:6f:d2:4b"/>
Nov 14 11:34:05 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:34:05 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:34:05 user nova-compute[75255]:       <target dev="tapee1afda3-2a"/>
Nov 14 11:34:05 user nova-compute[75255]:     </interface>
Nov 14 11:34:05 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:34:05 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/console.log" append="off"/>
Nov 14 11:34:05 user nova-compute[75255]:     </serial>
Nov 14 11:34:05 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:34:05 user nova-compute[75255]:     <video>
Nov 14 11:34:05 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:34:05 user nova-compute[75255]:     </video>
Nov 14 11:34:05 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:34:05 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:34:05 user nova-compute[75255]:     </rng>
Nov 14 11:34:05 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:34:05 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:34:05 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:34:05 user nova-compute[75255]:     </memballoon>
Nov 14 11:34:05 user nova-compute[75255]:   </devices>
Nov 14 11:34:05 user nova-compute[75255]: </domain>
Nov 14 11:34:05 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-743371484',display_name='tempest-ServersNegativeTestJSON-server-743371484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-743371484',id=43,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242dd529d2bc43f1bcc1e2feae480b64',ramdisk_id='',reservation_id='r-x2vpoc6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1020604939',owner_user_name='tempest-ServersNegativeTestJSON-1020604939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:34:03Z,user_data=None,user_id='2abf6da5049d4bc2a677ffa7d6cee58a',uuid=b9ac5751-d6fa-4136-9e02-c6856dfe5b98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converting VIF {"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d2:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee1afda3-2a68-411d-8323-cfa4fad59b16,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1afda3-2a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG os_vif [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d2:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee1afda3-2a68-411d-8323-cfa4fad59b16,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1afda3-2a') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9899fb14-4258-52be-a880-e10b634fd105', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee1afda3-2a, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee1afda3-2a, col_values=(('qos', UUID('490da606-80d1-4f52-b859-3a44e38cb804')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee1afda3-2a, col_values=(('external_ids', {'iface-id': 'ee1afda3-2a68-411d-8323-cfa4fad59b16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:d2:4b', 'vm-uuid': 'b9ac5751-d6fa-4136-9e02-c6856dfe5b98'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:05 user nova-compute[75255]: INFO os_vif [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d2:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee1afda3-2a68-411d-8323-cfa4fad59b16,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1afda3-2a')
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] No VIF found with MAC fa:16:3e:6f:d2:4b, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Updated VIF entry in instance network info cache for port ee1afda3-2a68-411d-8323-cfa4fad59b16. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Updating instance_info_cache with network_info: [{"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:34:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0ff3bc55-5f92-4ea4-989d-d70fc59cfaf4 req-6a1c3cfb-73f3-44fc-b7ed-4ce2226d792f service nova] Releasing lock "refresh_cache-b9ac5751-d6fa-4136-9e02-c6856dfe5b98" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-5aa3f81c-6e9d-4e3d-8975-0208ca94ce68 req-9c97d5ad-05db-449a-b9c0-7ea740782945 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received event network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5aa3f81c-6e9d-4e3d-8975-0208ca94ce68 req-9c97d5ad-05db-449a-b9c0-7ea740782945 service nova] Acquiring lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5aa3f81c-6e9d-4e3d-8975-0208ca94ce68 req-9c97d5ad-05db-449a-b9c0-7ea740782945 service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5aa3f81c-6e9d-4e3d-8975-0208ca94ce68 req-9c97d5ad-05db-449a-b9c0-7ea740782945 service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-5aa3f81c-6e9d-4e3d-8975-0208ca94ce68 req-9c97d5ad-05db-449a-b9c0-7ea740782945 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] No waiting events found dispatching network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:34:06 user nova-compute[75255]: WARNING nova.compute.manager [req-5aa3f81c-6e9d-4e3d-8975-0208ca94ce68 req-9c97d5ad-05db-449a-b9c0-7ea740782945 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received unexpected event network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 for instance with vm_state building and task_state spawning.
Nov 14 11:34:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:34:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Instance spawned successfully.
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:08 user nova-compute[75255]: INFO nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:34:08 user nova-compute[75255]: INFO nova.compute.manager [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Took 5.93 seconds to build instance.
Nov 14 11:34:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-690032d7-2a59-4f7b-b6bd-5f267883f32c tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.025s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-5fc03d71-bfaf-4eca-af05-1b8b9001b1cd req-f9bcfdd3-a9fa-41e5-a1f4-7a310dec3cf8 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received event network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5fc03d71-bfaf-4eca-af05-1b8b9001b1cd req-f9bcfdd3-a9fa-41e5-a1f4-7a310dec3cf8 service nova] Acquiring lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5fc03d71-bfaf-4eca-af05-1b8b9001b1cd req-f9bcfdd3-a9fa-41e5-a1f4-7a310dec3cf8 service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5fc03d71-bfaf-4eca-af05-1b8b9001b1cd req-f9bcfdd3-a9fa-41e5-a1f4-7a310dec3cf8 service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-5fc03d71-bfaf-4eca-af05-1b8b9001b1cd req-f9bcfdd3-a9fa-41e5-a1f4-7a310dec3cf8 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] No waiting events found dispatching network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:34:08 user nova-compute[75255]: WARNING nova.compute.manager [req-5fc03d71-bfaf-4eca-af05-1b8b9001b1cd req-f9bcfdd3-a9fa-41e5-a1f4-7a310dec3cf8 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received unexpected event network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 for instance with vm_state active and task_state None.
Nov 14 11:34:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-changed-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:34:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Refreshing instance network info cache due to event network-changed-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:34:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] Acquiring lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:34:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] Acquired lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:34:09 user nova-compute[75255]: DEBUG nova.network.neutron [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Refreshing network info cache for port 2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:34:09 user nova-compute[75255]: DEBUG nova.network.neutron [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updated VIF entry in instance network info cache for port 2a3d5b29-9478-4a00-bbab-c2db14e1ec5b. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:34:09 user nova-compute[75255]: DEBUG nova.network.neutron [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating instance_info_cache with network_info: [{"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:34:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-721c6637-2edb-4f6a-9355-2b0c994872b2 req-ea1c37e9-a4a3-44a8-93d8-58a16e154ac4 service nova] Releasing lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:34:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:11 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:34:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:12 user nova-compute[75255]: INFO nova.compute.manager [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attaching volume 82e6614e-34b6-4321-98da-15bf20d2c9f5 to /dev/vdb
Nov 14 11:34:12 user nova-compute[75255]: DEBUG os_brick.utils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ee5d1-555b-415d-b998-9569c0661fe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2baca-e218-45c7-8baa-56070148c617]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cffb66-14af-4689-b5f6-d6e4c594c58e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872eb71-c115-4abd-b34f-55f5cfd4873e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:34:12 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:34:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf831351-46d2-4951-8205-d714ccd89209]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG os_brick.utils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:34:12 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating existing volume attachment record: 60310525-8014-4148-9465-3535f9225439 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:34:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:34:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:13 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:34:13 user nova-compute[75255]: INFO nova.compute.claims [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Claim successful on node user
Nov 14 11:34:14 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:34:14 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:34:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:34:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:34:14 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:34:14 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:34:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:34:14 user nova-compute[75255]: DEBUG nova.policy [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99569798a7b14c20ab22ed26a0b11fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae08eed848f44bda5da3485b0b6b374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:34:14 user nova-compute[75255]: INFO nova.virt.block_device [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Booting with volume snapshot 33d62950-0a92-424f-a81b-2f469f5dfd77 at /dev/vda
Nov 14 11:34:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Successfully created port: 791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Successfully updated port: 791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "refresh_cache-6b275d69-3cde-49fb-915a-ce4f4e3f77d5" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquired lock "refresh_cache-6b275d69-3cde-49fb-915a-ce4f4e3f77d5" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-changed-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Refreshing instance network info cache due to event network-changed-791448d7-e915-4f9d-9066-5175a0b030a9. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:34:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] Acquiring lock "refresh_cache-6b275d69-3cde-49fb-915a-ce4f4e3f77d5" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Updating instance_info_cache with network_info: [{"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Releasing lock "refresh_cache-6b275d69-3cde-49fb-915a-ce4f4e3f77d5" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Instance network_info: |[{"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] Acquired lock "refresh_cache-6b275d69-3cde-49fb-915a-ce4f4e3f77d5" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Refreshing network info cache for port 791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Updated VIF entry in instance network info cache for port 791448d7-e915-4f9d-9066-5175a0b030a9. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Updating instance_info_cache with network_info: [{"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7ea6cad1-ee19-4e3b-96b5-3cecba54dac1 req-678b0fab-41e9-4229-996d-65912f6a1d62 service nova] Releasing lock "refresh_cache-6b275d69-3cde-49fb-915a-ce4f4e3f77d5" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDRrjfvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:34:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:34:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:34:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:34:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:34:16 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:34:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[389b28d1-66e4-40d4-a251-7b1b715a9ce0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:34:16 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1cda1c-9318-4e82-93fa-249242ae0892]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5] added
Nov 14 11:34:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c219b-0cc4-4a06-830d-3f87d62a5b46]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0688130b-76a3-4717-b016-f52c0ec50854]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDRrjfvF {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDRrjfvF" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8d5178-ad88-4921-8e76-3018133ef121]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZDRrjfvF'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3948eb-4813-4a11-8c87-0caa30aac517]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[133f78a8-ac08-406c-882f-f69b5b902db0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:34:17 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:34:17 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:34:17 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:34:17 user nova-compute[75255]: 
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[116af680-9f45-4fa8-a83e-9efcf8ceaa31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260]
Nov 14 11:34:17 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260] successful.
Nov 14 11:34:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe764d2-de82-4429-bef9-ee26fa244da4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5ca859-3e5d-4f77-a712-0062b6535299]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:17 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc0e04a-403e-484e-958b-35cd0ecbcd77]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:17 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDRrjfvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23136623430306162', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136623430306162', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:34:18 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:34:18 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:34:18 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:34:18 user nova-compute[75255]:   <serial>82e6614e-34b6-4321-98da-15bf20d2c9f5</serial>
Nov 14 11:34:18 user nova-compute[75255]: </disk>
Nov 14 11:34:18 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No VIF found with MAC fa:16:3e:87:af:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:34:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e9bffa55-7487-4b19-88df-a301e5ec1e9a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.837s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG os_brick.utils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd667985-bbce-40a8-a7b2-6c9ab879df9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece81677-b4ba-4631-ae44-d761c64e334a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e4c9e-71b1-4d15-8d9d-4f55434bede1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[20781603-bd85-4f92-b4fc-7aad5201e884]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:34:20 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:34:20 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[285d61df-7757-4b73-8b87-35f9929a092a]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG os_brick.utils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:34:20 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Updating existing volume attachment record: 13452f72-26e2-4ecc-a3f5-a000be04c5a5 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:34:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Creating image(s)
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Ensure instance console log exists: /opt/stack/data/nova/instances/6b275d69-3cde-49fb-915a-ce4f4e3f77d5/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Start _get_guest_xml network_info=[{"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '13452f72-26e2-4ecc-a3f5-a000be04c5a5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKvmlsCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b275d69-3cde-49fb-915a-ce4f4e3f77d5', 'attached_at': '', 'detached_at': '', 'volume_id': '2a48a3ea-2605-4223-a40b-8fbe96fb1833', 'serial': '2a48a3ea-2605-4223-a40b-8fbe96fb1833'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:34:25 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:34:25 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKvmlsCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:34:25 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:34:25 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:34:25 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f758a22-790a-4021-ae9c-417ae385f0c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:34:25 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[782df930-37f6-40c8-aeb6-b81dc7f9ae2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833] added
Nov 14 11:34:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e303d82-2317-4d45-8f95-339680519c2a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1db4561-40ff-4f32-8e5c-bfe4d9464a60]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKvmlsCd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKvmlsCd" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53cea0-33f6-4bfc-bbc4-cf9f78f72d59]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKvmlsCd'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d899c4e-96a3-42b9-99c3-3ee09be3ff9a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d866a956-02de-4f54-ae71-10dff23c7e7e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0bfbd2-669c-4d5b-b8c4-01eb07d0b0aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260]
Nov 14 11:34:25 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260] successful.
Nov 14 11:34:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d50d67-70c1-4060-b330-4fd22d21e1fd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed40db5-6d31-4380-86a4-1efd59b38248]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:25 user nova-compute[75255]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:34:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:25 user nova-compute[75255]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:34:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[570dac77-0d7a-41f9-83f3-4d9921b8cbf3]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:34:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKvmlsCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26133333638366330', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133333638366330', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-165394500',display_name='tempest-TestVolumeBootPattern-server-165394500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-165394500',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-rzgo3ukp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:34:14Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=6b275d69-3cde-49fb-915a-ce4f4e3f77d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:b1,bridge_name='br-int',has_traffic_filtering=True,id=791448d7-e915-4f9d-9066-5175a0b030a9,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791448d7-e9') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b275d69-3cde-49fb-915a-ce4f4e3f77d5 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:34:27 user nova-compute[75255]:   <uuid>6b275d69-3cde-49fb-915a-ce4f4e3f77d5</uuid>
Nov 14 11:34:27 user nova-compute[75255]:   <name>instance-0000002c</name>
Nov 14 11:34:27 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:34:27 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:34:27 user nova-compute[75255]:   <metadata>
Nov 14 11:34:27 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:34:27 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:34:27 user nova-compute[75255]:       <nova:name>tempest-TestVolumeBootPattern-server-165394500</nova:name>
Nov 14 11:34:27 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:34:25</nova:creationTime>
Nov 14 11:34:27 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:34:27 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:34:27 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:34:27 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:34:27 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:34:27 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:34:27 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:34:27 user nova-compute[75255]:       <nova:owner>
Nov 14 11:34:27 user nova-compute[75255]:         <nova:user uuid="99569798a7b14c20ab22ed26a0b11fd2">tempest-TestVolumeBootPattern-1575864965-project-member</nova:user>
Nov 14 11:34:27 user nova-compute[75255]:         <nova:project uuid="5ae08eed848f44bda5da3485b0b6b374">tempest-TestVolumeBootPattern-1575864965</nova:project>
Nov 14 11:34:27 user nova-compute[75255]:       </nova:owner>
Nov 14 11:34:27 user nova-compute[75255]:       <nova:ports>
Nov 14 11:34:27 user nova-compute[75255]:         <nova:port uuid="791448d7-e915-4f9d-9066-5175a0b030a9">
Nov 14 11:34:27 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 11:34:27 user nova-compute[75255]:         </nova:port>
Nov 14 11:34:27 user nova-compute[75255]:       </nova:ports>
Nov 14 11:34:27 user nova-compute[75255]:     </nova:instance>
Nov 14 11:34:27 user nova-compute[75255]:   </metadata>
Nov 14 11:34:27 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:34:27 user nova-compute[75255]:     <system>
Nov 14 11:34:27 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:34:27 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:34:27 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:34:27 user nova-compute[75255]:       <entry name="serial">6b275d69-3cde-49fb-915a-ce4f4e3f77d5</entry>
Nov 14 11:34:27 user nova-compute[75255]:       <entry name="uuid">6b275d69-3cde-49fb-915a-ce4f4e3f77d5</entry>
Nov 14 11:34:27 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:34:27 user nova-compute[75255]:     </system>
Nov 14 11:34:27 user nova-compute[75255]:   </sysinfo>
Nov 14 11:34:27 user nova-compute[75255]:   <os>
Nov 14 11:34:27 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:34:27 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:34:27 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:34:27 user nova-compute[75255]:   </os>
Nov 14 11:34:27 user nova-compute[75255]:   <features>
Nov 14 11:34:27 user nova-compute[75255]:     <acpi/>
Nov 14 11:34:27 user nova-compute[75255]:     <apic/>
Nov 14 11:34:27 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:34:27 user nova-compute[75255]:   </features>
Nov 14 11:34:27 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:34:27 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:34:27 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:34:27 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:34:27 user nova-compute[75255]:   </clock>
Nov 14 11:34:27 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:34:27 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:34:27 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:34:27 user nova-compute[75255]:   </cpu>
Nov 14 11:34:27 user nova-compute[75255]:   <devices>
Nov 14 11:34:27 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:34:27 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:34:27 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:34:27 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:34:27 user nova-compute[75255]:       <serial>2a48a3ea-2605-4223-a40b-8fbe96fb1833</serial>
Nov 14 11:34:27 user nova-compute[75255]:     </disk>
Nov 14 11:34:27 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:34:27 user nova-compute[75255]:       <mac address="fa:16:3e:84:5f:b1"/>
Nov 14 11:34:27 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:34:27 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:34:27 user nova-compute[75255]:       <target dev="tap791448d7-e9"/>
Nov 14 11:34:27 user nova-compute[75255]:     </interface>
Nov 14 11:34:27 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:34:27 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/6b275d69-3cde-49fb-915a-ce4f4e3f77d5/console.log" append="off"/>
Nov 14 11:34:27 user nova-compute[75255]:     </serial>
Nov 14 11:34:27 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:34:27 user nova-compute[75255]:     <video>
Nov 14 11:34:27 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:34:27 user nova-compute[75255]:     </video>
Nov 14 11:34:27 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:34:27 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:34:27 user nova-compute[75255]:     </rng>
Nov 14 11:34:27 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:34:27 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:34:27 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:34:27 user nova-compute[75255]:     </memballoon>
Nov 14 11:34:27 user nova-compute[75255]:   </devices>
Nov 14 11:34:27 user nova-compute[75255]: </domain>
Nov 14 11:34:27 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-165394500',display_name='tempest-TestVolumeBootPattern-server-165394500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-165394500',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-rzgo3ukp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:34:14Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=6b275d69-3cde-49fb-915a-ce4f4e3f77d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:b1,bridge_name='br-int',has_traffic_filtering=True,id=791448d7-e915-4f9d-9066-5175a0b030a9,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791448d7-e9') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG os_vif [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:b1,bridge_name='br-int',has_traffic_filtering=True,id=791448d7-e915-4f9d-9066-5175a0b030a9,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791448d7-e9') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '039ff92b-ae58-5079-8f21-7b070211c30e', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap791448d7-e9, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap791448d7-e9, col_values=(('qos', UUID('9cd30698-cef7-4452-a0b3-0884881001f2')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap791448d7-e9, col_values=(('external_ids', {'iface-id': '791448d7-e915-4f9d-9066-5175a0b030a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:5f:b1', 'vm-uuid': '6b275d69-3cde-49fb-915a-ce4f4e3f77d5'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:27 user nova-compute[75255]: INFO os_vif [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:b1,bridge_name='br-int',has_traffic_filtering=True,id=791448d7-e915-4f9d-9066-5175a0b030a9,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791448d7-e9')
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:34:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No VIF found with MAC fa:16:3e:84:5f:b1, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-5bb7c42e-e217-41c8-b594-13eb6ad601c3 req-80a30672-c3c5-4a23-8d9b-71317ff5e22b service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5bb7c42e-e217-41c8-b594-13eb6ad601c3 req-80a30672-c3c5-4a23-8d9b-71317ff5e22b service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5bb7c42e-e217-41c8-b594-13eb6ad601c3 req-80a30672-c3c5-4a23-8d9b-71317ff5e22b service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5bb7c42e-e217-41c8-b594-13eb6ad601c3 req-80a30672-c3c5-4a23-8d9b-71317ff5e22b service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-5bb7c42e-e217-41c8-b594-13eb6ad601c3 req-80a30672-c3c5-4a23-8d9b-71317ff5e22b service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:34:28 user nova-compute[75255]: WARNING nova.compute.manager [req-5bb7c42e-e217-41c8-b594-13eb6ad601c3 req-80a30672-c3c5-4a23-8d9b-71317ff5e22b service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received unexpected event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with vm_state building and task_state spawning.
Nov 14 11:34:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:28 user nova-compute[75255]: INFO nova.compute.manager [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Detaching volume 82e6614e-34b6-4321-98da-15bf20d2c9f5
Nov 14 11:34:28 user nova-compute[75255]: INFO nova.virt.block_device [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attempting to driver detach volume 82e6614e-34b6-4321-98da-15bf20d2c9f5 from mountpoint /dev/vdb
Nov 14 11:34:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Attempting to detach device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:34:28 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:34:28 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:34:28 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:34:28 user nova-compute[75255]:   <serial>82e6614e-34b6-4321-98da-15bf20d2c9f5</serial>
Nov 14 11:34:28 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:34:28 user nova-compute[75255]: </disk>
Nov 14 11:34:28 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:34:28 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config.
Nov 14 11:34:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:34:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:34:28 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:34:28 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:34:28 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:34:28 user nova-compute[75255]:   <serial>82e6614e-34b6-4321-98da-15bf20d2c9f5</serial>
Nov 14 11:34:28 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:34:28 user nova-compute[75255]: </disk>
Nov 14 11:34:28 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:34:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:34:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Instance spawned successfully.
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:34:30 user nova-compute[75255]: INFO nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-0478d209-d38a-4732-89c8-686bb657a8c8 req-2aec6c36-90aa-498d-8450-253720c7d65f service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0478d209-d38a-4732-89c8-686bb657a8c8 req-2aec6c36-90aa-498d-8450-253720c7d65f service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0478d209-d38a-4732-89c8-686bb657a8c8 req-2aec6c36-90aa-498d-8450-253720c7d65f service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0478d209-d38a-4732-89c8-686bb657a8c8 req-2aec6c36-90aa-498d-8450-253720c7d65f service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-0478d209-d38a-4732-89c8-686bb657a8c8 req-2aec6c36-90aa-498d-8450-253720c7d65f service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:34:30 user nova-compute[75255]: WARNING nova.compute.manager [req-0478d209-d38a-4732-89c8-686bb657a8c8 req-2aec6c36-90aa-498d-8450-253720c7d65f service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received unexpected event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with vm_state building and task_state spawning.
Nov 14 11:34:30 user nova-compute[75255]: INFO nova.compute.manager [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Took 16.78 seconds to build instance.
Nov 14 11:34:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-2c5ee5ed-c44d-4d68-9e32-b43ec21b373f tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.870s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:49 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 is timed out.
Nov 14 11:34:49 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config.
Nov 14 11:34:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDRrjfvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:34:49 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a685ea-18ce-422d-9272-2f18b166e34c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:34:49 user nova-compute[75255]: No targets found.
Nov 14 11:34:49 user nova-compute[75255]: iSNS:
Nov 14 11:34:49 user nova-compute[75255]: No targets found.
Nov 14 11:34:49 user nova-compute[75255]: STATIC:
Nov 14 11:34:49 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833
Nov 14 11:34:49 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:34:49 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:34:49 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5
Nov 14 11:34:49 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:34:49 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:34:49 user nova-compute[75255]: FIRMWARE:
Nov 14 11:34:49 user nova-compute[75255]: No targets found.
Nov 14 11:34:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:34:49 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:34:49 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd12247-4c6b-42db-86de-4a804a560f1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6131d488-6d03-4b17-b20e-8a403f9bb3fa]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:49 user nova-compute[75255]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:34:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 (non-flash)
Nov 14 11:34:49 user nova-compute[75255]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:34:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30875b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[738f4bab-ddec-428c-983a-3b1a41917c09]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd0387c-9e24-4240-87e7-19b986758573]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c0c2b-99ed-4fee-91dd-818fdd432926]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b0ad9-2bd9-449c-a433-646948fbef85]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d4f2c-d712-46f1-ab88-0d7a7046be87]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[751e9e17-b7e8-4c27-8e87-7b568cfc51e7]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260]
Nov 14 11:34:49 user nova-compute[75255]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5, portal: 172.16.0.220,3260] successful.
Nov 14 11:34:49 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6614e-34b6-4321-98da-15bf20d2c9f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff2820-c933-41ab-a540-cc4a26879d19]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== disconnect_volume: return (299ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:34:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:34:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:50 user nova-compute[75255]: DEBUG nova.objects.instance [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:34:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-de71cfb3-2c4b-41e0-a427-74688b0a14e8 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.634s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:52 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:34:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:53 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:34:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:34:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.02886962890625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5900f8a3-9336-4788-82d7-a30270bbb218 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance b9ac5751-d6fa-4136-9e02-c6856dfe5b98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 6b275d69-3cde-49fb-915a-ce4f4e3f77d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:34:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:34:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:34:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:34:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:34:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:34:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:34:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:34:58 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating instance_info_cache with network_info: [{"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:34:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:34:58 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:34:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:35:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:35:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:35:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:35:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:35:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:35:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:35:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:35:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:35:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:21 user nova-compute[75255]: INFO nova.compute.manager [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attaching volume 8f48cfd0-7e1e-4991-95d2-b072c7d043e7 to /dev/vdb
Nov 14 11:35:21 user nova-compute[75255]: DEBUG os_brick.utils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e28c96-47a6-424b-87f5-c96e8f800553]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755acf0-d381-4540-8746-8d74b23a6013]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eeba0e-7f23-4aac-9b37-ef21f0efc001]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f0eed-9b87-42db-9156-a3971f73715d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:35:21 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:35:21 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[576b69c9-07dc-40a1-80b0-9ff9e9b8ad39]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG os_brick.utils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:35:21 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating existing volume attachment record: 76ccfa80-e768-4077-b1be-48637a312874 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:35:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:25 user nova-compute[75255]: INFO nova.compute.manager [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Unshelving
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'pci_requests' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:35:25 user nova-compute[75255]: INFO nova.compute.claims [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Claim successful on node user
Nov 14 11:35:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWznVrLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:35:25 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:35:25 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:35:25 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[45770faa-d138-4a9a-a8e3-28357baba549]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:35:25 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[beddb72d-cb54-4398-9622-015bcc2f77d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7] added
Nov 14 11:35:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b0f8c-8fc5-42e9-99e3-ef016f884f37]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424b639-1d0e-49c3-9ad6-d3f6b4d2d6de]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AWznVrLy {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AWznVrLy" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28c2d9-d261-4e37-8854-da2e63b54cd3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AWznVrLy'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b3ce91-caf7-4587-a0b8-327c40fb7dfb]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[42255a49-df9f-4a91-91c5-7d507e291ede]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:35:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:35:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b756e5f6-c0e6-4958-a111-b908fe769a74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260]
Nov 14 11:35:25 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260] successful.
Nov 14 11:35:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6758ccf4-b40e-455a-97b7-74975ced7765]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.076s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dc43e0-84ac-41a3-817d-abe2a1debb96]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:35:25 user nova-compute[75255]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 (non-flash)
Nov 14 11:35:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:35:25 user nova-compute[75255]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 (non-flash)
Nov 14 11:35:25 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:35:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8ec16-21b3-482e-97d8-b1f71de284c9]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:26 user nova-compute[75255]: INFO nova.network.neutron [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating port e39ee0d8-cb8e-4456-806d-6b0935f109e1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing instance network info cache due to event network-changed-e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:35:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWznVrLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23235316435393737', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235316435393737', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.network.neutron [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:35:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Creating image(s)
Nov 14 11:35:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.network.neutron [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Refreshing network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:35:27 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:35:27 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:35:27 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:35:27 user nova-compute[75255]:   <serial>8f48cfd0-7e1e-4991-95d2-b072c7d043e7</serial>
Nov 14 11:35:27 user nova-compute[75255]: </disk>
Nov 14 11:35:27 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG nova.objects.base [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<4d79ec1c-ad29-4b5f-a5d0-2993d70b2639> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "edf6da6276a4726ab7c25809c64ddad9d593342d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "edf6da6276a4726ab7c25809c64ddad9d593342d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.part --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No VIF found with MAC fa:16:3e:87:af:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG nova.virt.images [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] 0cf37f07-1e91-4ab8-9db6-01a2e543b584 was qcow2, converting to raw {{(pid=75255) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG nova.privsep.utils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75255) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.part /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.converted {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5073d98c-9c13-4b25-9fe6-95d51bb6f558 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.299s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updated VIF entry in instance network info cache for port e39ee0d8-cb8e-4456-806d-6b0935f109e1. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-295e13b1-13b8-4f63-9d25-41058b7e94e5 req-c4c78e2e-b022-4f4c-96e9-1b0f8f266cf9 service nova] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.part /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.converted" returned: 0 in 0.490s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.converted --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "edf6da6276a4726ab7c25809c64ddad9d593342d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.959s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "edf6da6276a4726ab7c25809c64ddad9d593342d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "edf6da6276a4726ab7c25809c64ddad9d593342d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d,backing_fmt=raw /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d,backing_fmt=raw /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk 1073741824" returned: 0 in 0.047s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "edf6da6276a4726ab7c25809c64ddad9d593342d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'migration_context' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG nova.objects.base [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<4d79ec1c-ad29-4b5f-a5d0-2993d70b2639> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:35:29 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Rebasing disk image.
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:29 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 -F raw /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:30 user nova-compute[75255]: INFO nova.compute.manager [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Detaching volume 8f48cfd0-7e1e-4991-95d2-b072c7d043e7
Nov 14 11:35:30 user nova-compute[75255]: INFO nova.virt.block_device [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attempting to driver detach volume 8f48cfd0-7e1e-4991-95d2-b072c7d043e7 from mountpoint /dev/vdb
Nov 14 11:35:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Attempting to detach device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:35:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:35:30 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:35:30 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:35:30 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:35:30 user nova-compute[75255]:   <serial>8f48cfd0-7e1e-4991-95d2-b072c7d043e7</serial>
Nov 14 11:35:30 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:35:30 user nova-compute[75255]: </disk>
Nov 14 11:35:30 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:35:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config.
Nov 14 11:35:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:35:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:35:30 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:35:30 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:35:30 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:35:30 user nova-compute[75255]:   <serial>8f48cfd0-7e1e-4991-95d2-b072c7d043e7</serial>
Nov 14 11:35:30 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:35:30 user nova-compute[75255]: </disk>
Nov 14 11:35:30 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:35:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 -F raw /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk" returned: 0 in 2.580s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Ensure instance console log exists: /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Start _get_guest_xml network_info=[{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2041bb1345732b043d9a03433f2b8c06',container_format='bare',created_at=2023-11-14T11:33:32Z,direct_url=<?>,disk_format='qcow2',id=0cf37f07-1e91-4ab8-9db6-01a2e543b584,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-671095676-shelved',owner='539e7facdc2a4ce081fa5eff222d0193',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T11:33:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:35:32 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:35:32 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2041bb1345732b043d9a03433f2b8c06',container_format='bare',created_at=2023-11-14T11:33:32Z,direct_url=<?>,disk_format='qcow2',id=0cf37f07-1e91-4ab8-9db6-01a2e543b584,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-671095676-shelved',owner='539e7facdc2a4ce081fa5eff222d0193',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T11:33:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.objects.base [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<4d79ec1c-ad29-4b5f-a5d0-2993d70b2639> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671095676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671095676',id=40,image_ref='0cf37f07-1e91-4ab8-9db6-01a2e543b584',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2111564517',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-bvowop90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member',shelved_at='2023-11-14T11:33:36.794019',shelved_host='user',shelved_image_id='0cf37f07-1e91-4ab8-9db6-01a2e543b584'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=4d79ec1c-ad29-4b5f-a5d0-2993d70b2639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.objects.instance [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.objects.base [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Object Instance<4d79ec1c-ad29-4b5f-a5d0-2993d70b2639> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:35:32 user nova-compute[75255]:   <uuid>4d79ec1c-ad29-4b5f-a5d0-2993d70b2639</uuid>
Nov 14 11:35:32 user nova-compute[75255]:   <name>instance-00000028</name>
Nov 14 11:35:32 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:35:32 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:35:32 user nova-compute[75255]:   <metadata>
Nov 14 11:35:32 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:35:32 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:35:32 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-671095676</nova:name>
Nov 14 11:35:32 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:35:32</nova:creationTime>
Nov 14 11:35:32 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:35:32 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:35:32 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:35:32 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:35:32 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:35:32 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:35:32 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:35:32 user nova-compute[75255]:       <nova:owner>
Nov 14 11:35:32 user nova-compute[75255]:         <nova:user uuid="7b4b049ae1654b4495e42b8ec2cb11f9">tempest-AttachVolumeShelveTestJSON-479009518-project-member</nova:user>
Nov 14 11:35:32 user nova-compute[75255]:         <nova:project uuid="539e7facdc2a4ce081fa5eff222d0193">tempest-AttachVolumeShelveTestJSON-479009518</nova:project>
Nov 14 11:35:32 user nova-compute[75255]:       </nova:owner>
Nov 14 11:35:32 user nova-compute[75255]:       <nova:root type="image" uuid="0cf37f07-1e91-4ab8-9db6-01a2e543b584"/>
Nov 14 11:35:32 user nova-compute[75255]:       <nova:ports>
Nov 14 11:35:32 user nova-compute[75255]:         <nova:port uuid="e39ee0d8-cb8e-4456-806d-6b0935f109e1">
Nov 14 11:35:32 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 11:35:32 user nova-compute[75255]:         </nova:port>
Nov 14 11:35:32 user nova-compute[75255]:       </nova:ports>
Nov 14 11:35:32 user nova-compute[75255]:     </nova:instance>
Nov 14 11:35:32 user nova-compute[75255]:   </metadata>
Nov 14 11:35:32 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:35:32 user nova-compute[75255]:     <system>
Nov 14 11:35:32 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:35:32 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:35:32 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:35:32 user nova-compute[75255]:       <entry name="serial">4d79ec1c-ad29-4b5f-a5d0-2993d70b2639</entry>
Nov 14 11:35:32 user nova-compute[75255]:       <entry name="uuid">4d79ec1c-ad29-4b5f-a5d0-2993d70b2639</entry>
Nov 14 11:35:32 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:35:32 user nova-compute[75255]:     </system>
Nov 14 11:35:32 user nova-compute[75255]:   </sysinfo>
Nov 14 11:35:32 user nova-compute[75255]:   <os>
Nov 14 11:35:32 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:35:32 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:35:32 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:35:32 user nova-compute[75255]:   </os>
Nov 14 11:35:32 user nova-compute[75255]:   <features>
Nov 14 11:35:32 user nova-compute[75255]:     <acpi/>
Nov 14 11:35:32 user nova-compute[75255]:     <apic/>
Nov 14 11:35:32 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:35:32 user nova-compute[75255]:   </features>
Nov 14 11:35:32 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:35:32 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:35:32 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:35:32 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:35:32 user nova-compute[75255]:   </clock>
Nov 14 11:35:32 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:35:32 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:35:32 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:35:32 user nova-compute[75255]:   </cpu>
Nov 14 11:35:32 user nova-compute[75255]:   <devices>
Nov 14 11:35:32 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:35:32 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:35:32 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk"/>
Nov 14 11:35:32 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:35:32 user nova-compute[75255]:     </disk>
Nov 14 11:35:32 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:35:32 user nova-compute[75255]:       <mac address="fa:16:3e:f0:93:f2"/>
Nov 14 11:35:32 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:35:32 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:35:32 user nova-compute[75255]:       <target dev="tape39ee0d8-cb"/>
Nov 14 11:35:32 user nova-compute[75255]:     </interface>
Nov 14 11:35:32 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:35:32 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/console.log" append="off"/>
Nov 14 11:35:32 user nova-compute[75255]:     </serial>
Nov 14 11:35:32 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:35:32 user nova-compute[75255]:     <video>
Nov 14 11:35:32 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:35:32 user nova-compute[75255]:     </video>
Nov 14 11:35:32 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:35:32 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:35:32 user nova-compute[75255]:     </rng>
Nov 14 11:35:32 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:35:32 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:35:32 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:35:32 user nova-compute[75255]:     </memballoon>
Nov 14 11:35:32 user nova-compute[75255]:   </devices>
Nov 14 11:35:32 user nova-compute[75255]: </domain>
Nov 14 11:35:32 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671095676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671095676',id=40,image_ref='0cf37f07-1e91-4ab8-9db6-01a2e543b584',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2111564517',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-bvowop90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member',shelved_at='2023-11-14T11:33:36.794019',shelved_host='user',shelved_image_id='0cf37f07-1e91-4ab8-9db6-01a2e543b584'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=4d79ec1c-ad29-4b5f-a5d0-2993d70b2639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG os_vif [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89b05aff-8ff4-5c7c-ac66-031efd2ab456', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape39ee0d8-cb, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape39ee0d8-cb, col_values=(('qos', UUID('2efba96b-d3dc-45be-9c1f-ccdfbe7d83f2')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape39ee0d8-cb, col_values=(('external_ids', {'iface-id': 'e39ee0d8-cb8e-4456-806d-6b0935f109e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:93:f2', 'vm-uuid': '4d79ec1c-ad29-4b5f-a5d0-2993d70b2639'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:32 user nova-compute[75255]: INFO os_vif [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb')
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:35:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] No VIF found with MAC fa:16:3e:f0:93:f2, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:35:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-c8e11227-c74b-4ed8-a24f-64d3284fbdb0 req-d8fc1ff8-2f39-4b27-a118-c12f098b0881 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c8e11227-c74b-4ed8-a24f-64d3284fbdb0 req-d8fc1ff8-2f39-4b27-a118-c12f098b0881 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c8e11227-c74b-4ed8-a24f-64d3284fbdb0 req-d8fc1ff8-2f39-4b27-a118-c12f098b0881 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c8e11227-c74b-4ed8-a24f-64d3284fbdb0 req-d8fc1ff8-2f39-4b27-a118-c12f098b0881 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-c8e11227-c74b-4ed8-a24f-64d3284fbdb0 req-d8fc1ff8-2f39-4b27-a118-c12f098b0881 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:35:34 user nova-compute[75255]: WARNING nova.compute.manager [req-c8e11227-c74b-4ed8-a24f-64d3284fbdb0 req-d8fc1ff8-2f39-4b27-a118-c12f098b0881 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 11:35:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:35:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:35:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance spawned successfully.
Nov 14 11:35:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-ae63a032-3a33-450c-8355-6f625efcb039 req-8953d887-39d5-4b52-bcf1-65419ee707d3 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:35:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ae63a032-3a33-450c-8355-6f625efcb039 req-8953d887-39d5-4b52-bcf1-65419ee707d3 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ae63a032-3a33-450c-8355-6f625efcb039 req-8953d887-39d5-4b52-bcf1-65419ee707d3 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ae63a032-3a33-450c-8355-6f625efcb039 req-8953d887-39d5-4b52-bcf1-65419ee707d3 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-ae63a032-3a33-450c-8355-6f625efcb039 req-8953d887-39d5-4b52-bcf1-65419ee707d3 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:35:36 user nova-compute[75255]: WARNING nova.compute.manager [req-ae63a032-3a33-450c-8355-6f625efcb039 req-8953d887-39d5-4b52-bcf1-65419ee707d3 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 11:35:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:35:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-8195250c-bfa9-488e-88e2-7e5c565bd1e4 tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.923s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:50 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 is timed out.
Nov 14 11:35:50 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config.
Nov 14 11:35:50 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWznVrLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:35:50 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb02e7a-ff2b-46b3-9c29-36793577d8fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:35:50 user nova-compute[75255]: No targets found.
Nov 14 11:35:50 user nova-compute[75255]: iSNS:
Nov 14 11:35:50 user nova-compute[75255]: No targets found.
Nov 14 11:35:50 user nova-compute[75255]: STATIC:
Nov 14 11:35:50 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7
Nov 14 11:35:50 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:35:50 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:35:50 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833
Nov 14 11:35:50 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:35:50 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:35:50 user nova-compute[75255]: FIRMWARE:
Nov 14 11:35:50 user nova-compute[75255]: No targets found.
Nov 14 11:35:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:35:50 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:35:50 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[981e9b74-8e1e-4eee-ad8b-f4967e5a4713]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32511ba-d36e-4599-b41d-3c56c2a3d9d9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:35:50 user nova-compute[75255]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 (non-flash)
Nov 14 11:35:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:35:50 user nova-compute[75255]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 (non-flash)
Nov 14 11:35:50 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281dcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c945329-4a03-49ca-b35c-f4d2569a05da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71218b6-e131-465e-b3b7-5a44dfc08b34]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b5181-dee0-4e4c-a614-32b1833d99c3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5cd626-8a45-4d99-9b64-240c37d183f3]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:35:50 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781e515-0ef4-4329-9426-2f34ab9ec929]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d3af8-425c-4484-817c-1d206dd66b82]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260]
Nov 14 11:35:51 user nova-compute[75255]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7, portal: 172.16.0.220,3260] successful.
Nov 14 11:35:51 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f48cfd0-7e1e-4991-95d2-b072c7d043e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b499055a-058c-4f5a-aea3-e77904aafbb5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== disconnect_volume: return (277ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a6ab474-f90c-4ae9-92b6-1e95900eebe9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.626s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:52 user nova-compute[75255]: INFO nova.compute.manager [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Terminating instance
Nov 14 11:35:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-3fd91973-7e75-425f-8fa5-76bcdfae3ca6 req-7c4440b1-e498-4b68-9c72-8f4498e132f4 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received event network-vif-unplugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3fd91973-7e75-425f-8fa5-76bcdfae3ca6 req-7c4440b1-e498-4b68-9c72-8f4498e132f4 service nova] Acquiring lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3fd91973-7e75-425f-8fa5-76bcdfae3ca6 req-7c4440b1-e498-4b68-9c72-8f4498e132f4 service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3fd91973-7e75-425f-8fa5-76bcdfae3ca6 req-7c4440b1-e498-4b68-9c72-8f4498e132f4 service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-3fd91973-7e75-425f-8fa5-76bcdfae3ca6 req-7c4440b1-e498-4b68-9c72-8f4498e132f4 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] No waiting events found dispatching network-vif-unplugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-3fd91973-7e75-425f-8fa5-76bcdfae3ca6 req-7c4440b1-e498-4b68-9c72-8f4498e132f4 service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received event network-vif-unplugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Instance destroyed successfully.
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lazy-loading 'resources' on Instance uuid b9ac5751-d6fa-4136-9e02-c6856dfe5b98 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-743371484',display_name='tempest-ServersNegativeTestJSON-server-743371484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-743371484',id=43,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242dd529d2bc43f1bcc1e2feae480b64',ramdisk_id='',reservation_id='r-x2vpoc6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1020604939',owner_user_name='tempest-ServersNegativeTestJSON-1020604939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:34:09Z,user_data=None,user_id='2abf6da5049d4bc2a677ffa7d6cee58a',uuid=b9ac5751-d6fa-4136-9e02-c6856dfe5b98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converting VIF {"id": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "address": "fa:16:3e:6f:d2:4b", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1afda3-2a", "ovs_interfaceid": "ee1afda3-2a68-411d-8323-cfa4fad59b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d2:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee1afda3-2a68-411d-8323-cfa4fad59b16,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1afda3-2a') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG os_vif [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d2:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee1afda3-2a68-411d-8323-cfa4fad59b16,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1afda3-2a') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee1afda3-2a, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=490da606-80d1-4f52-b859-3a44e38cb804) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:53 user nova-compute[75255]: INFO os_vif [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d2:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee1afda3-2a68-411d-8323-cfa4fad59b16,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1afda3-2a')
Nov 14 11:35:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Deleting instance files /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98_del
Nov 14 11:35:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Deletion of /opt/stack/data/nova/instances/b9ac5751-d6fa-4136-9e02-c6856dfe5b98_del complete
Nov 14 11:35:53 user nova-compute[75255]: INFO nova.compute.manager [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 14 11:35:53 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:35:53 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:35:54 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Took 0.42 seconds to deallocate network for instance.
Nov 14 11:35:54 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG nova.compute.manager [req-ee723148-e943-4116-b8b7-cfe4bb4cfe1c req-a428be3b-2089-4d74-a031-bb37137d2bca service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received event network-vif-deleted-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:35:54 user nova-compute[75255]: INFO nova.compute.manager [req-ee723148-e943-4116-b8b7-cfe4bb4cfe1c req-a428be3b-2089-4d74-a031-bb37137d2bca service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Neutron deleted interface ee1afda3-2a68-411d-8323-cfa4fad59b16; detaching it from the instance and deleting it from the info cache
Nov 14 11:35:54 user nova-compute[75255]: DEBUG nova.network.neutron [req-ee723148-e943-4116-b8b7-cfe4bb4cfe1c req-a428be3b-2089-4d74-a031-bb37137d2bca service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG nova.compute.manager [req-ee723148-e943-4116-b8b7-cfe4bb4cfe1c req-a428be3b-2089-4d74-a031-bb37137d2bca service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Detach interface failed, port_id=ee1afda3-2a68-411d-8323-cfa4fad59b16, reason: Instance b9ac5751-d6fa-4136-9e02-c6856dfe5b98 could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:35:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:54 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Deleted allocations for instance b9ac5751-d6fa-4136-9e02-c6856dfe5b98
Nov 14 11:35:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdb6caf8-b037-42d1-9083-824a06d9bb0f tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.563s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-d02b83c5-e4a2-43d0-a6bf-a1b47447d056 req-0bdfb601-697e-44e7-b944-2304aa36825d service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received event network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d02b83c5-e4a2-43d0-a6bf-a1b47447d056 req-0bdfb601-697e-44e7-b944-2304aa36825d service nova] Acquiring lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d02b83c5-e4a2-43d0-a6bf-a1b47447d056 req-0bdfb601-697e-44e7-b944-2304aa36825d service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d02b83c5-e4a2-43d0-a6bf-a1b47447d056 req-0bdfb601-697e-44e7-b944-2304aa36825d service nova] Lock "b9ac5751-d6fa-4136-9e02-c6856dfe5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-d02b83c5-e4a2-43d0-a6bf-a1b47447d056 req-0bdfb601-697e-44e7-b944-2304aa36825d service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] No waiting events found dispatching network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:35:55 user nova-compute[75255]: WARNING nova.compute.manager [req-d02b83c5-e4a2-43d0-a6bf-a1b47447d056 req-0bdfb601-697e-44e7-b944-2304aa36825d service nova] [instance: b9ac5751-d6fa-4136-9e02-c6856dfe5b98] Received unexpected event network-vif-plugged-ee1afda3-2a68-411d-8323-cfa4fad59b16 for instance with vm_state deleted and task_state None.
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:55 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:35:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:35:56 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=25.03002166748047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5900f8a3-9336-4788-82d7-a30270bbb218 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 6b275d69-3cde-49fb-915a-ce4f4e3f77d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:35:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:35:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:35:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [{"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:35:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:36:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:04 user nova-compute[75255]: INFO nova.compute.manager [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Terminating instance
Nov 14 11:36:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c9af337-8f0c-4426-b5af-7653846ead3f req-4e2e3759-183a-418b-9135-2fc81e0d1736 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-unplugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c9af337-8f0c-4426-b5af-7653846ead3f req-4e2e3759-183a-418b-9135-2fc81e0d1736 service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c9af337-8f0c-4426-b5af-7653846ead3f req-4e2e3759-183a-418b-9135-2fc81e0d1736 service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8c9af337-8f0c-4426-b5af-7653846ead3f req-4e2e3759-183a-418b-9135-2fc81e0d1736 service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c9af337-8f0c-4426-b5af-7653846ead3f req-4e2e3759-183a-418b-9135-2fc81e0d1736 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-unplugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:36:04 user nova-compute[75255]: DEBUG nova.compute.manager [req-8c9af337-8f0c-4426-b5af-7653846ead3f req-4e2e3759-183a-418b-9135-2fc81e0d1736 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-unplugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Instance destroyed successfully.
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.objects.instance [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'resources' on Instance uuid 6b275d69-3cde-49fb-915a-ce4f4e3f77d5 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-165394500',display_name='tempest-TestVolumeBootPattern-server-165394500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-165394500',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:34:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-rzgo3ukp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:34:31Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=6b275d69-3cde-49fb-915a-ce4f4e3f77d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "791448d7-e915-4f9d-9066-5175a0b030a9", "address": "fa:16:3e:84:5f:b1", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791448d7-e9", "ovs_interfaceid": "791448d7-e915-4f9d-9066-5175a0b030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:b1,bridge_name='br-int',has_traffic_filtering=True,id=791448d7-e915-4f9d-9066-5175a0b030a9,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791448d7-e9') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_vif [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:b1,bridge_name='br-int',has_traffic_filtering=True,id=791448d7-e915-4f9d-9066-5175a0b030a9,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791448d7-e9') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap791448d7-e9, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cd30698-cef7-4452-a0b3-0884881001f2) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: INFO os_vif [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:b1,bridge_name='br-int',has_traffic_filtering=True,id=791448d7-e915-4f9d-9066-5175a0b030a9,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791448d7-e9')
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKvmlsCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:36:05 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e1a19a-6ac1-43be-ac66-42350924f3bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:36:05 user nova-compute[75255]: No targets found.
Nov 14 11:36:05 user nova-compute[75255]: iSNS:
Nov 14 11:36:05 user nova-compute[75255]: No targets found.
Nov 14 11:36:05 user nova-compute[75255]: STATIC:
Nov 14 11:36:05 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833
Nov 14 11:36:05 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:36:05 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:36:05 user nova-compute[75255]: FIRMWARE:
Nov 14 11:36:05 user nova-compute[75255]: No targets found.
Nov 14 11:36:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:36:05 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:36:05 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0363d1cd-049b-42d8-8896-7543911f90e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e0dfae-04b8-43ed-a3d9-658987109d8c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:36:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 (non-flash)
Nov 14 11:36:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff328472830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f1d5a6-04c0-4389-9437-48ae7b0d8ed8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec67d43f-2afc-4cbb-8ae9-02715bc74683]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7177d8b7-e7ee-49b2-bb3a-787239d01d39]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b5adb0-f3b7-4c35-a8c1-bfc00b36699a]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26133333638366330', '/dev/disk/by-id/scsi-1SCST_BIOd09975fc-a33686c009533bfd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d09975fc') {{(pid=86497) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 11:36:05 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26133333638366330
Nov 14 11:36:05 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd09975fc-a33686c009533bfd
Nov 14 11:36:05 user nova-compute[75255]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d09975fc
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f3d59f-ba58-4331-b8b4-57c0bffe57a5]: (4, None) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66f2ef6-0c02-47f4-a7d9-c415f32612cc]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0156a1-41ca-4ac2-b11b-9c34f5c81a64]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260]
Nov 14 11:36:05 user nova-compute[75255]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833, portal: 172.16.0.220,3260] successful.
Nov 14 11:36:05 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a48a3ea-2605-4223-a40b-8fbe96fb1833 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a609e18-ff61-46e1-8c04-4d236b5dc329]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== disconnect_volume: return (337ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:36:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Deleting instance files /opt/stack/data/nova/instances/6b275d69-3cde-49fb-915a-ce4f4e3f77d5_del
Nov 14 11:36:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Deletion of /opt/stack/data/nova/instances/6b275d69-3cde-49fb-915a-ce4f4e3f77d5_del complete
Nov 14 11:36:05 user nova-compute[75255]: INFO nova.compute.manager [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 14 11:36:05 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:36:06 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Took 0.64 seconds to deallocate network for instance.
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-d39c0452-a4df-4f56-8d5d-da6aad1ea997 req-13dccb8e-df3a-471a-9539-c8134b373ee7 service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-deleted-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:36:06 user nova-compute[75255]: WARNING nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received unexpected event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with vm_state active and task_state deleting.
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:36:06 user nova-compute[75255]: WARNING nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received unexpected event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with vm_state active and task_state deleting.
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:36:06 user nova-compute[75255]: WARNING nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received unexpected event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with vm_state active and task_state deleting.
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-unplugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-unplugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-unplugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Acquiring lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:06 user nova-compute[75255]: DEBUG nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] No waiting events found dispatching network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:36:06 user nova-compute[75255]: WARNING nova.compute.manager [req-8911278f-9fbf-4686-98d5-dfc37b334097 req-91865c4f-6907-40f7-b2f4-6f8f25b028ba service nova] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Received unexpected event network-vif-plugged-791448d7-e915-4f9d-9066-5175a0b030a9 for instance with vm_state active and task_state deleting.
Nov 14 11:36:07 user nova-compute[75255]: INFO nova.compute.manager [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 11:36:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 6b275d69-3cde-49fb-915a-ce4f4e3f77d5] Deleting volume: 2a48a3ea-2605-4223-a40b-8fbe96fb1833 {{(pid=75255) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 11:36:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:07 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:36:07 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:36:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:07 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Deleted allocations for instance 6b275d69-3cde-49fb-915a-ce4f4e3f77d5
Nov 14 11:36:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27ed76d9-48a0-456d-bb00-6d37fd11d71e tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "6b275d69-3cde-49fb-915a-ce4f4e3f77d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.056s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:22 user nova-compute[75255]: INFO nova.compute.manager [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attaching volume 213d63ee-fad7-43de-a7e3-f416638cc241 to /dev/vdb
Nov 14 11:36:22 user nova-compute[75255]: DEBUG os_brick.utils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd7c08d-33b7-446d-bbf8-2dc4a8ae7c08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0fbee5-94ca-40ee-a98c-48ce33eab2ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5dbbde-8b0d-4dd1-b9c7-0cf44d7a45e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c5a1da-7e8a-4439-8bfe-9c05df79e516]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:36:22 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:36:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e64242-0618-43d5-9a8b-7ef165569525]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG os_brick.utils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:36:22 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating existing volume attachment record: 503ea24d-fc8a-45c6-9dbe-70cade7cd67c {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:36:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGQaZbMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:36:27 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:36:27 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:36:27 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[417bcd80-f214-49c8-844f-fe57aaa6b416]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:36:27 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d55cdf-928d-477d-b807-de9ce4059d12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241] added
Nov 14 11:36:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2120f6-75d6-49ce-a3cb-6a1074fc3eb6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2bbda2-3335-4e44-bd3b-c3dabd5c031f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGQaZbMy {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGQaZbMy" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d68e06-7583-4bff-956f-ae869cdb8f5b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YGQaZbMy'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2fd3bd-4bcd-4d93-aa74-80af903cd89c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56b2680-5374-4982-891c-6550da5c1c8c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:36:27 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:36:27 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:36:27 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:36:27 user nova-compute[75255]: 
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e237ea-a5a7-465c-8c3b-899d870c05ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260]
Nov 14 11:36:27 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260] successful.
Nov 14 11:36:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacc37c9-3622-494e-bf29-aeeb206043dd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d21d1e0-e06c-4953-86b9-f6510e93e9e7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 (non-flash)
Nov 14 11:36:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 (non-flash)
Nov 14 11:36:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f3cf88-f80d-417b-b25d-ed9e09da6b6e]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:36:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGQaZbMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:36:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:36:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26366613863616166', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:36:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366613863616166', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:36:28 user nova-compute[75255]: DEBUG nova.objects.instance [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:36:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:36:28 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:36:28 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:36:28 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:36:28 user nova-compute[75255]:   <serial>213d63ee-fad7-43de-a7e3-f416638cc241</serial>
Nov 14 11:36:28 user nova-compute[75255]: </disk>
Nov 14 11:36:28 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:36:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:36:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:36:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No VIF found with MAC fa:16:3e:87:af:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:36:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-4f846551-4817-4124-9948-5244d7a081a7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.882s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:31 user nova-compute[75255]: INFO nova.compute.manager [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Detaching volume 213d63ee-fad7-43de-a7e3-f416638cc241
Nov 14 11:36:31 user nova-compute[75255]: INFO nova.virt.block_device [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attempting to driver detach volume 213d63ee-fad7-43de-a7e3-f416638cc241 from mountpoint /dev/vdb
Nov 14 11:36:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Attempting to detach device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:36:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:36:31 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:36:31 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:36:31 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:36:31 user nova-compute[75255]:   <serial>213d63ee-fad7-43de-a7e3-f416638cc241</serial>
Nov 14 11:36:31 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:36:31 user nova-compute[75255]: </disk>
Nov 14 11:36:31 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:36:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config.
Nov 14 11:36:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:36:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:36:31 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:36:31 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:36:31 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:36:31 user nova-compute[75255]:   <serial>213d63ee-fad7-43de-a7e3-f416638cc241</serial>
Nov 14 11:36:31 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:36:31 user nova-compute[75255]: </disk>
Nov 14 11:36:31 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:36:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:36:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:40 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:36:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:36:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:36:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:36:52 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 is timed out.
Nov 14 11:36:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config.
Nov 14 11:36:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGQaZbMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:36:52 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[81208bd4-0b9d-409d-adf4-6e840df3c36e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:36:52 user nova-compute[75255]: No targets found.
Nov 14 11:36:52 user nova-compute[75255]: iSNS:
Nov 14 11:36:52 user nova-compute[75255]: No targets found.
Nov 14 11:36:52 user nova-compute[75255]: STATIC:
Nov 14 11:36:52 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241
Nov 14 11:36:52 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:36:52 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:36:52 user nova-compute[75255]: FIRMWARE:
Nov 14 11:36:52 user nova-compute[75255]: No targets found.
Nov 14 11:36:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:36:52 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:36:52 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a508d-3a7f-4676-afdb-498872d15ad9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f59495-e364-4aed-b442-21527843e5d8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 (non-flash)
Nov 14 11:36:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 (non-flash)
Nov 14 11:36:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281dc9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d40aba-d01e-4fa9-8c94-dbd4e4ad7a9a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2411976b-12bd-48db-af65-53dedfdd1a24]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3782fd-2f9f-4afd-8a93-f5e9697a2069]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[55082bb3-324a-4bc8-930f-5e5094b58877]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6c74fe-10bf-4764-826f-333d45c3a614]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b09fce0-a18d-47f2-9ee8-76022ccc8fc1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260]
Nov 14 11:36:52 user nova-compute[75255]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241, portal: 172.16.0.220,3260] successful.
Nov 14 11:36:52 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213d63ee-fad7-43de-a7e3-f416638cc241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6329fab5-3aab-4b89-9608-3baf98a56f19]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== disconnect_volume: return (314ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:36:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:36:53 user nova-compute[75255]: DEBUG nova.objects.instance [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:36:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-66fba8af-1cac-4139-a559-2b5176613fc7 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.838s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:56 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:36:57 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:36:57 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.02831268310547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5900f8a3-9336-4788-82d7-a30270bbb218 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:36:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:37:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updating instance_info_cache with network_info: [{"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:37:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "a80fddda-41de-44b8-bde3-9a60b7d8d732" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:37:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:03 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:37:03 user nova-compute[75255]: INFO nova.compute.claims [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Claim successful on node user
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:37:04 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.policy [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99569798a7b14c20ab22ed26a0b11fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae08eed848f44bda5da3485b0b6b374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:37:04 user nova-compute[75255]: INFO nova.virt.block_device [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Booting with volume 9ba35372-78f7-474c-a6ca-c83ffa5f2750 at /dev/vda
Nov 14 11:37:04 user nova-compute[75255]: DEBUG os_brick.utils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8f1328-1ca6-4547-9726-811d42e068a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63d1ea2-1442-41dd-a762-7b22d1429ede]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ecf1fb-2363-4c63-807d-c03fdf772c67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2763259-27d3-4ae8-bc06-bd8b7263fb3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:37:04 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:37:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daaf1c3-bd8e-49ec-954f-78e09fca0239]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG os_brick.utils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updating existing volume attachment record: eeb4ac33-2dac-45f9-83fb-18f570b9b9db {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:37:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Successfully created port: 190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Successfully updated port: 190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquired lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-changed-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.compute.manager [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Refreshing instance network info cache due to event network-changed-190f34c6-6ee1-4b8b-a548-0f18fec28b9d. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] Acquiring lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updating instance_info_cache with network_info: [{"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Releasing lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Instance network_info: |[{"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] Acquired lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:37:05 user nova-compute[75255]: DEBUG nova.network.neutron [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Refreshing network info cache for port 190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:37:06 user nova-compute[75255]: DEBUG nova.network.neutron [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updated VIF entry in instance network info cache for port 190f34c6-6ee1-4b8b-a548-0f18fec28b9d. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:37:06 user nova-compute[75255]: DEBUG nova.network.neutron [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updating instance_info_cache with network_info: [{"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:37:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76a4be0a-cbc8-4cbd-b23b-a7522e948981 req-2b4772c4-590d-4188-90df-435ce8444af3 service nova] Releasing lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:37:08 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Creating image(s)
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Ensure instance console log exists: /opt/stack/data/nova/instances/a80fddda-41de-44b8-bde3-9a60b7d8d732/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Start _get_guest_xml network_info=[{"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'eeb4ac33-2dac-45f9-83fb-18f570b9b9db', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdinRkCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a80fddda-41de-44b8-bde3-9a60b7d8d732', 'attached_at': '', 'detached_at': '', 'volume_id': '9ba35372-78f7-474c-a6ca-c83ffa5f2750', 'serial': '9ba35372-78f7-474c-a6ca-c83ffa5f2750'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:37:08 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:37:08 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdinRkCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:37:08 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:37:08 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:37:08 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9333b-f14d-44b6-b92b-d15828ba375a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:37:08 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec88891a-582b-487c-bd3f-ab267a92baf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750] added
Nov 14 11:37:08 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee31abd-23cc-4d12-999c-4903cd0d74ee]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a888c141-3ab4-4157-a32d-045857bc9b13]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdinRkCQ {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdinRkCQ" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab63d6f4-545e-4a4c-9e3c-7b95eae8cfc5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WdinRkCQ'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[665a4e4b-2273-491d-87f5-9ff224a95a11]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[88576321-6141-4270-87eb-2a0bdb212715]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:37:08 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:37:08 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:37:08 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:37:08 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:37:08 user nova-compute[75255]: 
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7666444-24b4-471b-a039-e237710a222b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260]
Nov 14 11:37:09 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260] successful.
Nov 14 11:37:09 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bdda42-5d06-48d9-9c1e-6973433f057a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a2530-a144-4082-b2d0-d9933df749de]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:09 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:09 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb259c-51b9-4a90-8a97-adaf590c26a7]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:09 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdinRkCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23239623861396538', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239623861396538', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2088325150',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2088325150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2088325150',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOuiA/UZVpX3DQmaoD1tZxmIvSl48+EWQYuxzwsVzYI9ffxcKIQrM6v32MU7Pz/xm20K2DDt3G9y3D33nS7Dhf1DknWDmtdFfJrHc3lVnvDEptp4CZR4HTKc0bMIevrfg==',key_name='tempest-keypair-1186577102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-ny2at8im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=a80fddda-41de-44b8-bde3-9a60b7d8d732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:93:a4,bridge_name='br-int',has_traffic_filtering=True,id=190f34c6-6ee1-4b8b-a548-0f18fec28b9d,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190f34c6-6e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'pci_devices' on Instance uuid a80fddda-41de-44b8-bde3-9a60b7d8d732 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:37:10 user nova-compute[75255]:   <uuid>a80fddda-41de-44b8-bde3-9a60b7d8d732</uuid>
Nov 14 11:37:10 user nova-compute[75255]:   <name>instance-0000002d</name>
Nov 14 11:37:10 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:37:10 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:37:10 user nova-compute[75255]:   <metadata>
Nov 14 11:37:10 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:37:10 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:37:10 user nova-compute[75255]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2088325150</nova:name>
Nov 14 11:37:10 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:37:08</nova:creationTime>
Nov 14 11:37:10 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:37:10 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:37:10 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:37:10 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:37:10 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:37:10 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:37:10 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:37:10 user nova-compute[75255]:       <nova:owner>
Nov 14 11:37:10 user nova-compute[75255]:         <nova:user uuid="99569798a7b14c20ab22ed26a0b11fd2">tempest-TestVolumeBootPattern-1575864965-project-member</nova:user>
Nov 14 11:37:10 user nova-compute[75255]:         <nova:project uuid="5ae08eed848f44bda5da3485b0b6b374">tempest-TestVolumeBootPattern-1575864965</nova:project>
Nov 14 11:37:10 user nova-compute[75255]:       </nova:owner>
Nov 14 11:37:10 user nova-compute[75255]:       <nova:ports>
Nov 14 11:37:10 user nova-compute[75255]:         <nova:port uuid="190f34c6-6ee1-4b8b-a548-0f18fec28b9d">
Nov 14 11:37:10 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 11:37:10 user nova-compute[75255]:         </nova:port>
Nov 14 11:37:10 user nova-compute[75255]:       </nova:ports>
Nov 14 11:37:10 user nova-compute[75255]:     </nova:instance>
Nov 14 11:37:10 user nova-compute[75255]:   </metadata>
Nov 14 11:37:10 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:37:10 user nova-compute[75255]:     <system>
Nov 14 11:37:10 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:37:10 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:37:10 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:37:10 user nova-compute[75255]:       <entry name="serial">a80fddda-41de-44b8-bde3-9a60b7d8d732</entry>
Nov 14 11:37:10 user nova-compute[75255]:       <entry name="uuid">a80fddda-41de-44b8-bde3-9a60b7d8d732</entry>
Nov 14 11:37:10 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:37:10 user nova-compute[75255]:     </system>
Nov 14 11:37:10 user nova-compute[75255]:   </sysinfo>
Nov 14 11:37:10 user nova-compute[75255]:   <os>
Nov 14 11:37:10 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:37:10 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:37:10 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:37:10 user nova-compute[75255]:   </os>
Nov 14 11:37:10 user nova-compute[75255]:   <features>
Nov 14 11:37:10 user nova-compute[75255]:     <acpi/>
Nov 14 11:37:10 user nova-compute[75255]:     <apic/>
Nov 14 11:37:10 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:37:10 user nova-compute[75255]:   </features>
Nov 14 11:37:10 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:37:10 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:37:10 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:37:10 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:37:10 user nova-compute[75255]:   </clock>
Nov 14 11:37:10 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:37:10 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:37:10 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:37:10 user nova-compute[75255]:   </cpu>
Nov 14 11:37:10 user nova-compute[75255]:   <devices>
Nov 14 11:37:10 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:37:10 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:37:10 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:37:10 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:37:10 user nova-compute[75255]:       <serial>9ba35372-78f7-474c-a6ca-c83ffa5f2750</serial>
Nov 14 11:37:10 user nova-compute[75255]:     </disk>
Nov 14 11:37:10 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:37:10 user nova-compute[75255]:       <mac address="fa:16:3e:7e:93:a4"/>
Nov 14 11:37:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:37:10 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:37:10 user nova-compute[75255]:       <target dev="tap190f34c6-6e"/>
Nov 14 11:37:10 user nova-compute[75255]:     </interface>
Nov 14 11:37:10 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:37:10 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/a80fddda-41de-44b8-bde3-9a60b7d8d732/console.log" append="off"/>
Nov 14 11:37:10 user nova-compute[75255]:     </serial>
Nov 14 11:37:10 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:37:10 user nova-compute[75255]:     <video>
Nov 14 11:37:10 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:37:10 user nova-compute[75255]:     </video>
Nov 14 11:37:10 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:37:10 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:37:10 user nova-compute[75255]:     </rng>
Nov 14 11:37:10 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:37:10 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:37:10 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:37:10 user nova-compute[75255]:     </memballoon>
Nov 14 11:37:10 user nova-compute[75255]:   </devices>
Nov 14 11:37:10 user nova-compute[75255]: </domain>
Nov 14 11:37:10 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2088325150',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2088325150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2088325150',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOuiA/UZVpX3DQmaoD1tZxmIvSl48+EWQYuxzwsVzYI9ffxcKIQrM6v32MU7Pz/xm20K2DDt3G9y3D33nS7Dhf1DknWDmtdFfJrHc3lVnvDEptp4CZR4HTKc0bMIevrfg==',key_name='tempest-keypair-1186577102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-ny2at8im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=a80fddda-41de-44b8-bde3-9a60b7d8d732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:93:a4,bridge_name='br-int',has_traffic_filtering=True,id=190f34c6-6ee1-4b8b-a548-0f18fec28b9d,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190f34c6-6e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG os_vif [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:93:a4,bridge_name='br-int',has_traffic_filtering=True,id=190f34c6-6ee1-4b8b-a548-0f18fec28b9d,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190f34c6-6e') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f4051fa-dd25-5a3c-b976-7b4319c90805', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap190f34c6-6e, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap190f34c6-6e, col_values=(('qos', UUID('299e9a36-df0b-40ff-957f-97a11a82cf93')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap190f34c6-6e, col_values=(('external_ids', {'iface-id': '190f34c6-6ee1-4b8b-a548-0f18fec28b9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:93:a4', 'vm-uuid': 'a80fddda-41de-44b8-bde3-9a60b7d8d732'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:10 user nova-compute[75255]: INFO os_vif [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:93:a4,bridge_name='br-int',has_traffic_filtering=True,id=190f34c6-6ee1-4b8b-a548-0f18fec28b9d,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190f34c6-6e')
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:37:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No VIF found with MAC fa:16:3e:7e:93:a4, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-7e9738bf-5048-466a-bf05-e91eaa3a619e req-c9d73f27-12ba-44c5-a8b8-9d2397adb8f0 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e9738bf-5048-466a-bf05-e91eaa3a619e req-c9d73f27-12ba-44c5-a8b8-9d2397adb8f0 service nova] Acquiring lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e9738bf-5048-466a-bf05-e91eaa3a619e req-c9d73f27-12ba-44c5-a8b8-9d2397adb8f0 service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7e9738bf-5048-466a-bf05-e91eaa3a619e req-c9d73f27-12ba-44c5-a8b8-9d2397adb8f0 service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-7e9738bf-5048-466a-bf05-e91eaa3a619e req-c9d73f27-12ba-44c5-a8b8-9d2397adb8f0 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] No waiting events found dispatching network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:11 user nova-compute[75255]: WARNING nova.compute.manager [req-7e9738bf-5048-466a-bf05-e91eaa3a619e req-c9d73f27-12ba-44c5-a8b8-9d2397adb8f0 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received unexpected event network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d for instance with vm_state building and task_state spawning.
Nov 14 11:37:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:37:13 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Instance spawned successfully.
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:37:13 user nova-compute[75255]: INFO nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-fbd2d143-bf31-4e3d-ad66-c18d92a5d2fb req-fadeadf4-88af-4920-89c2-ffecdc13a25b service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fbd2d143-bf31-4e3d-ad66-c18d92a5d2fb req-fadeadf4-88af-4920-89c2-ffecdc13a25b service nova] Acquiring lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fbd2d143-bf31-4e3d-ad66-c18d92a5d2fb req-fadeadf4-88af-4920-89c2-ffecdc13a25b service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fbd2d143-bf31-4e3d-ad66-c18d92a5d2fb req-fadeadf4-88af-4920-89c2-ffecdc13a25b service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-fbd2d143-bf31-4e3d-ad66-c18d92a5d2fb req-fadeadf4-88af-4920-89c2-ffecdc13a25b service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] No waiting events found dispatching network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:13 user nova-compute[75255]: WARNING nova.compute.manager [req-fbd2d143-bf31-4e3d-ad66-c18d92a5d2fb req-fadeadf4-88af-4920-89c2-ffecdc13a25b service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received unexpected event network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d for instance with vm_state building and task_state spawning.
Nov 14 11:37:13 user nova-compute[75255]: INFO nova.compute.manager [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Took 9.98 seconds to build instance.
Nov 14 11:37:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-aa9c86aa-382f-43f0-9c5a-c73e78e21977 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.074s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:15 user nova-compute[75255]: INFO nova.compute.manager [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Terminating instance
Nov 14 11:37:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-36fd71f3-1503-42f4-8ee6-4362c3ddf6d4 req-f6da6d16-03a1-4509-b6b9-c2fa0a9d1b45 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36fd71f3-1503-42f4-8ee6-4362c3ddf6d4 req-f6da6d16-03a1-4509-b6b9-c2fa0a9d1b45 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36fd71f3-1503-42f4-8ee6-4362c3ddf6d4 req-f6da6d16-03a1-4509-b6b9-c2fa0a9d1b45 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36fd71f3-1503-42f4-8ee6-4362c3ddf6d4 req-f6da6d16-03a1-4509-b6b9-c2fa0a9d1b45 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-36fd71f3-1503-42f4-8ee6-4362c3ddf6d4 req-f6da6d16-03a1-4509-b6b9-c2fa0a9d1b45 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-36fd71f3-1503-42f4-8ee6-4362c3ddf6d4 req-f6da6d16-03a1-4509-b6b9-c2fa0a9d1b45 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Instance destroyed successfully.
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lazy-loading 'resources' on Instance uuid 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T11:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671095676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671095676',id=40,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEZcydkis+nH8CQnz/LYXSN9dvLCB+pcr0dr8cD7m7ye5Orf8bOOSZGeYsILUEiXIcPpGZieKtNVBn5VN0xDrk0UgY4kzTDulN239RlNgWWCu0p30El9KShBCOmZlhPdQ==',key_name='tempest-keypair-2111564517',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:35:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='539e7facdc2a4ce081fa5eff222d0193',ramdisk_id='',reservation_id='r-bvowop90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-479009518',owner_user_name='tempest-AttachVolumeShelveTestJSON-479009518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b4b049ae1654b4495e42b8ec2cb11f9',uuid=4d79ec1c-ad29-4b5f-a5d0-2993d70b2639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converting VIF {"id": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "address": "fa:16:3e:f0:93:f2", "network": {"id": "35c788a5-9aed-4456-a87f-9695e1ff7679", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1356741801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e7facdc2a4ce081fa5eff222d0193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39ee0d8-cb", "ovs_interfaceid": "e39ee0d8-cb8e-4456-806d-6b0935f109e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG os_vif [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape39ee0d8-cb, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2efba96b-d3dc-45be-9c1f-ccdfbe7d83f2) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:37:16 user nova-compute[75255]: INFO os_vif [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:93:f2,bridge_name='br-int',has_traffic_filtering=True,id=e39ee0d8-cb8e-4456-806d-6b0935f109e1,network=Network(35c788a5-9aed-4456-a87f-9695e1ff7679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39ee0d8-cb')
Nov 14 11:37:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Deleting instance files /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639_del
Nov 14 11:37:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Deletion of /opt/stack/data/nova/instances/4d79ec1c-ad29-4b5f-a5d0-2993d70b2639_del complete
Nov 14 11:37:16 user nova-compute[75255]: INFO nova.compute.manager [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 14 11:37:16 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:37:16 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:37:17 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Took 0.99 seconds to deallocate network for instance.
Nov 14 11:37:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:18 user nova-compute[75255]: WARNING nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state deleted and task_state None.
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:18 user nova-compute[75255]: WARNING nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state deleted and task_state None.
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:18 user nova-compute[75255]: WARNING nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state deleted and task_state None.
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:18 user nova-compute[75255]: WARNING nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-unplugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state deleted and task_state None.
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Acquiring lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] No waiting events found dispatching network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:37:18 user nova-compute[75255]: WARNING nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received unexpected event network-vif-plugged-e39ee0d8-cb8e-4456-806d-6b0935f109e1 for instance with vm_state deleted and task_state None.
Nov 14 11:37:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-b5f6ede2-0f59-4aaf-874a-e9801f99d59b req-9213e715-0f1f-4b6d-9469-705bdd51f609 service nova] [instance: 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639] Received event network-vif-deleted-e39ee0d8-cb8e-4456-806d-6b0935f109e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:18 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Deleted allocations for instance 4d79ec1c-ad29-4b5f-a5d0-2993d70b2639
Nov 14 11:37:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-20fc3b57-78ab-4f55-a11e-1e88dadd2bdb tempest-AttachVolumeShelveTestJSON-479009518 tempest-AttachVolumeShelveTestJSON-479009518-project-member] Lock "4d79ec1c-ad29-4b5f-a5d0-2993d70b2639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.447s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:23 user nova-compute[75255]: INFO nova.compute.manager [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attaching volume 0b0b3032-43a4-44c4-8b58-d08a5b70b75d to /dev/vdb
Nov 14 11:37:23 user nova-compute[75255]: DEBUG os_brick.utils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ede19-3b6f-42ad-b57e-8da938c5a559]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec25be4-359f-4433-bb57-f404b72d8377]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[92326998-5a62-42d8-8ba3-09b14942d1f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[95365042-8182-4ff2-8287-16e971b0c8d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:37:24 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:37:24 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb34524-a1a0-4fe4-bdf1-d9048bb8b005]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG os_brick.utils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:37:24 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating existing volume attachment record: 80a36087-966c-426c-9aa0-5c9b04131ba7 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:37:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAJRqbLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:37:28 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:37:28 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:37:28 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e26c860-3de3-48d4-9a50-2f26053eca45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:37:28 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[323aad37-7183-4f86-96b0-ce43fb53828a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d] added
Nov 14 11:37:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410ae16-98ea-43b6-8c12-cd94651ab6af]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5a49e-1f11-465e-b8b8-a55514912678]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAJRqbLM {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAJRqbLM" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[189afb85-26cc-4e37-b62b-1b1e2eb878c1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PAJRqbLM'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3531cf-03b7-42fb-9a9b-d302cf6ff6bf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a178d5-fc04-48da-bd46-7cde34fcbbfe]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e31b8e-0029-49d6-893d-9dcee61f335d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260]
Nov 14 11:37:28 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260] successful.
Nov 14 11:37:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c380566-e03e-4056-838a-5ae36e82a5d7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3109d4a6-441d-4fc0-87e9-e7f6cea455e2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:28 user nova-compute[75255]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d (non-flash)
Nov 14 11:37:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:28 user nova-compute[75255]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d (non-flash)
Nov 14 11:37:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e751af9-d5f3-470e-b260-22bddcef14ad]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:37:29 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:37:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAJRqbLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:37:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:37:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26664336332383363', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:37:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664336332383363', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:37:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:37:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:37:29 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:37:29 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:37:29 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:37:29 user nova-compute[75255]:   <serial>0b0b3032-43a4-44c4-8b58-d08a5b70b75d</serial>
Nov 14 11:37:29 user nova-compute[75255]: </disk>
Nov 14 11:37:29 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:37:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:37:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:37:30 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] No VIF found with MAC fa:16:3e:87:af:33, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:37:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d8d75dce-6895-4684-bcd0-35e1c7c8822f tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.646s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:32 user nova-compute[75255]: INFO nova.compute.manager [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Detaching volume 0b0b3032-43a4-44c4-8b58-d08a5b70b75d
Nov 14 11:37:32 user nova-compute[75255]: INFO nova.virt.block_device [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Attempting to driver detach volume 0b0b3032-43a4-44c4-8b58-d08a5b70b75d from mountpoint /dev/vdb
Nov 14 11:37:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Attempting to detach device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:37:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:37:32 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:37:32 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:37:32 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:37:32 user nova-compute[75255]:   <serial>0b0b3032-43a4-44c4-8b58-d08a5b70b75d</serial>
Nov 14 11:37:32 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:37:32 user nova-compute[75255]: </disk>
Nov 14 11:37:32 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:37:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the persistent domain config.
Nov 14 11:37:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:37:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:37:32 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:37:32 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:37:32 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:37:32 user nova-compute[75255]:   <serial>0b0b3032-43a4-44c4-8b58-d08a5b70b75d</serial>
Nov 14 11:37:32 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:37:32 user nova-compute[75255]: </disk>
Nov 14 11:37:32 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:37:33 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:37:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:42 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:46 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:37:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:53 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5900f8a3-9336-4788-82d7-a30270bbb218 is timed out.
Nov 14 11:37:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully detached device vdb from instance 5900f8a3-9336-4788-82d7-a30270bbb218 from the live domain config.
Nov 14 11:37:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAJRqbLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:37:53 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae219349-08e5-4c5c-aa9b-9215305de752]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:37:53 user nova-compute[75255]: No targets found.
Nov 14 11:37:53 user nova-compute[75255]: iSNS:
Nov 14 11:37:53 user nova-compute[75255]: No targets found.
Nov 14 11:37:53 user nova-compute[75255]: STATIC:
Nov 14 11:37:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750
Nov 14 11:37:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:37:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:37:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d
Nov 14 11:37:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:37:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:37:53 user nova-compute[75255]: FIRMWARE:
Nov 14 11:37:53 user nova-compute[75255]: No targets found.
Nov 14 11:37:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:37:53 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:37:53 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a439e702-250b-4663-9903-1197d43ea367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6658f27-5a62-49bc-96c3-1c61af061d2a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:53 user nova-compute[75255]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d (non-flash)
Nov 14 11:37:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:37:53 user nova-compute[75255]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d (non-flash)
Nov 14 11:37:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30875b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e540f3-d70e-4fec-ae48-0fe2983751ad]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49232c2-f711-4336-a1ac-61efa220c1c3]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ee05de-51df-499f-b22f-3045dc2a80af]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0494f98-5153-47e8-878c-92cca1518643]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c928dd95-fefd-4623-860a-92b450fd5c56]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e47b82-f5d2-450f-893a-dca10e23859c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260]
Nov 14 11:37:53 user nova-compute[75255]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d, portal: 172.16.0.220,3260] successful.
Nov 14 11:37:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0b3032-43a4-44c4-8b58-d08a5b70b75d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b03145d-3bd7-429b-a538-1f20f943995a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] <== disconnect_volume: return (282ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:37:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:37:54 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'flavor' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:37:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6ed51aee-b930-4594-a34c-51b0a1a182a9 tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.571s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:56 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:37:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:37:57 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:37:58 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:37:58 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=25.037899017333984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5900f8a3-9336-4788-82d7-a30270bbb218 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance a80fddda-41de-44b8-bde3-9a60b7d8d732 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:37:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:38:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:38:02 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating instance_info_cache with network_info: [{"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:38:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-5900f8a3-9336-4788-82d7-a30270bbb218" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:38:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:38:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:38:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:38:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:38:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:38:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:38:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:38:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:38:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:38:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:38:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:38:24 user nova-compute[75255]: INFO nova.compute.claims [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Claim successful on node user
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:38:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.policy [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd508f30ed89a4451a0a383019d98dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32711b26ee74011b2733543d7c60c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:38:24 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Creating image(s)
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:24 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk 1073741824" returned: 0 in 0.053s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Successfully created port: 66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Cannot resize image /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Ensure instance console log exists: /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Successfully updated port: 66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-changed-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Refreshing instance network info cache due to event network-changed-66e9baab-8248-4e5e-aec3-d0745bfaebec. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:38:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance network_info: |[{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Refreshing network info cache for port 66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Start _get_guest_xml network_info=[{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:38:26 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:38:26 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.objects.instance [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:38:26 user nova-compute[75255]:   <uuid>3e0a66b6-b8ef-4804-8197-39eaa11bed2b</uuid>
Nov 14 11:38:26 user nova-compute[75255]:   <name>instance-0000002e</name>
Nov 14 11:38:26 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:38:26 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:38:26 user nova-compute[75255]:   <metadata>
Nov 14 11:38:26 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:38:26 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:38:26 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeTestJSON-server-1911577971</nova:name>
Nov 14 11:38:26 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:38:26</nova:creationTime>
Nov 14 11:38:26 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:38:26 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:38:26 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:38:26 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:38:26 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:38:26 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:38:26 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:38:26 user nova-compute[75255]:       <nova:owner>
Nov 14 11:38:26 user nova-compute[75255]:         <nova:user uuid="d508f30ed89a4451a0a383019d98dae4">tempest-AttachVolumeTestJSON-545907524-project-member</nova:user>
Nov 14 11:38:26 user nova-compute[75255]:         <nova:project uuid="f32711b26ee74011b2733543d7c60c81">tempest-AttachVolumeTestJSON-545907524</nova:project>
Nov 14 11:38:26 user nova-compute[75255]:       </nova:owner>
Nov 14 11:38:26 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:38:26 user nova-compute[75255]:       <nova:ports>
Nov 14 11:38:26 user nova-compute[75255]:         <nova:port uuid="66e9baab-8248-4e5e-aec3-d0745bfaebec">
Nov 14 11:38:26 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:38:26 user nova-compute[75255]:         </nova:port>
Nov 14 11:38:26 user nova-compute[75255]:       </nova:ports>
Nov 14 11:38:26 user nova-compute[75255]:     </nova:instance>
Nov 14 11:38:26 user nova-compute[75255]:   </metadata>
Nov 14 11:38:26 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:38:26 user nova-compute[75255]:     <system>
Nov 14 11:38:26 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:38:26 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:38:26 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:38:26 user nova-compute[75255]:       <entry name="serial">3e0a66b6-b8ef-4804-8197-39eaa11bed2b</entry>
Nov 14 11:38:26 user nova-compute[75255]:       <entry name="uuid">3e0a66b6-b8ef-4804-8197-39eaa11bed2b</entry>
Nov 14 11:38:26 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:38:26 user nova-compute[75255]:     </system>
Nov 14 11:38:26 user nova-compute[75255]:   </sysinfo>
Nov 14 11:38:26 user nova-compute[75255]:   <os>
Nov 14 11:38:26 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:38:26 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:38:26 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:38:26 user nova-compute[75255]:   </os>
Nov 14 11:38:26 user nova-compute[75255]:   <features>
Nov 14 11:38:26 user nova-compute[75255]:     <acpi/>
Nov 14 11:38:26 user nova-compute[75255]:     <apic/>
Nov 14 11:38:26 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:38:26 user nova-compute[75255]:   </features>
Nov 14 11:38:26 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:38:26 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:38:26 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:38:26 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:38:26 user nova-compute[75255]:   </clock>
Nov 14 11:38:26 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:38:26 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:38:26 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:38:26 user nova-compute[75255]:   </cpu>
Nov 14 11:38:26 user nova-compute[75255]:   <devices>
Nov 14 11:38:26 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:38:26 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:38:26 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk"/>
Nov 14 11:38:26 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:38:26 user nova-compute[75255]:     </disk>
Nov 14 11:38:26 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:38:26 user nova-compute[75255]:       <mac address="fa:16:3e:0b:ec:8e"/>
Nov 14 11:38:26 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:38:26 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:38:26 user nova-compute[75255]:       <target dev="tap66e9baab-82"/>
Nov 14 11:38:26 user nova-compute[75255]:     </interface>
Nov 14 11:38:26 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:38:26 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/console.log" append="off"/>
Nov 14 11:38:26 user nova-compute[75255]:     </serial>
Nov 14 11:38:26 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:38:26 user nova-compute[75255]:     <video>
Nov 14 11:38:26 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:38:26 user nova-compute[75255]:     </video>
Nov 14 11:38:26 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:38:26 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:38:26 user nova-compute[75255]:     </rng>
Nov 14 11:38:26 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:38:26 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:38:26 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:38:26 user nova-compute[75255]:     </memballoon>
Nov 14 11:38:26 user nova-compute[75255]:   </devices>
Nov 14 11:38:26 user nova-compute[75255]: </domain>
Nov 14 11:38:26 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG os_vif [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99d33761-5596-50ec-97be-01ec57d99ef1', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66e9baab-82, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66e9baab-82, col_values=(('qos', UUID('e6ff21bd-2f2a-4949-967b-816fcd9813b9')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66e9baab-82, col_values=(('external_ids', {'iface-id': '66e9baab-8248-4e5e-aec3-d0745bfaebec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ec:8e', 'vm-uuid': '3e0a66b6-b8ef-4804-8197-39eaa11bed2b'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:26 user nova-compute[75255]: INFO os_vif [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82')
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No VIF found with MAC fa:16:3e:0b:ec:8e, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updated VIF entry in instance network info cache for port 66e9baab-8248-4e5e-aec3-d0745bfaebec. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:38:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ff4ca5f3-c610-42ae-a1ec-1ae03107832e req-2bd3fb8a-78d6-417f-b4e8-0cb467305996 service nova] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-e465d237-efb7-4fae-8ee4-b7893461538e req-37943d3d-519a-4307-88a6-e24ba9690be8 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e465d237-efb7-4fae-8ee4-b7893461538e req-37943d3d-519a-4307-88a6-e24ba9690be8 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e465d237-efb7-4fae-8ee4-b7893461538e req-37943d3d-519a-4307-88a6-e24ba9690be8 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e465d237-efb7-4fae-8ee4-b7893461538e req-37943d3d-519a-4307-88a6-e24ba9690be8 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-e465d237-efb7-4fae-8ee4-b7893461538e req-37943d3d-519a-4307-88a6-e24ba9690be8 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:38:27 user nova-compute[75255]: WARNING nova.compute.manager [req-e465d237-efb7-4fae-8ee4-b7893461538e req-37943d3d-519a-4307-88a6-e24ba9690be8 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state building and task_state spawning.
Nov 14 11:38:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:38:29 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance spawned successfully.
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:38:29 user nova-compute[75255]: INFO nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-631fa8b9-2e52-4084-ab45-30ca9e231505 req-c0ffb1f8-8ab3-455e-b884-29c7c51b8d77 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-631fa8b9-2e52-4084-ab45-30ca9e231505 req-c0ffb1f8-8ab3-455e-b884-29c7c51b8d77 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-631fa8b9-2e52-4084-ab45-30ca9e231505 req-c0ffb1f8-8ab3-455e-b884-29c7c51b8d77 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-631fa8b9-2e52-4084-ab45-30ca9e231505 req-c0ffb1f8-8ab3-455e-b884-29c7c51b8d77 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-631fa8b9-2e52-4084-ab45-30ca9e231505 req-c0ffb1f8-8ab3-455e-b884-29c7c51b8d77 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:38:29 user nova-compute[75255]: WARNING nova.compute.manager [req-631fa8b9-2e52-4084-ab45-30ca9e231505 req-c0ffb1f8-8ab3-455e-b884-29c7c51b8d77 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state building and task_state spawning.
Nov 14 11:38:29 user nova-compute[75255]: INFO nova.compute.manager [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Took 5.88 seconds to build instance.
Nov 14 11:38:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-dd428f07-27b1-44e3-a834-6999015fc983 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.007s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:35 user nova-compute[75255]: INFO nova.compute.manager [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Terminating instance
Nov 14 11:38:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-48fb1d03-50f0-48fa-89ad-0e4febdc1f03 req-f5c2bb60-16ed-4c0d-b170-310900f70fb8 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-vif-unplugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-48fb1d03-50f0-48fa-89ad-0e4febdc1f03 req-f5c2bb60-16ed-4c0d-b170-310900f70fb8 service nova] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-48fb1d03-50f0-48fa-89ad-0e4febdc1f03 req-f5c2bb60-16ed-4c0d-b170-310900f70fb8 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-48fb1d03-50f0-48fa-89ad-0e4febdc1f03 req-f5c2bb60-16ed-4c0d-b170-310900f70fb8 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-48fb1d03-50f0-48fa-89ad-0e4febdc1f03 req-f5c2bb60-16ed-4c0d-b170-310900f70fb8 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] No waiting events found dispatching network-vif-unplugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-48fb1d03-50f0-48fa-89ad-0e4febdc1f03 req-f5c2bb60-16ed-4c0d-b170-310900f70fb8 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-vif-unplugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:38:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Instance destroyed successfully.
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lazy-loading 'resources' on Instance uuid 5900f8a3-9336-4788-82d7-a30270bbb218 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1173906203',display_name='tempest-SnapshotDataIntegrityTests-server-1173906203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1173906203',id=42,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdUVRT3HuDepm/kPTgRJdPhOumLF2DKwWP+KBBalgj0Etvx5Dkf72d5F6hEY0CszuXwsrvnqYlNeEiSouFtbC8Y9vvuXjNGxnV6/YXrxAnPGJZEbkM40Lp4DkWgUscNYw==',key_name='tempest-keypair-136710357',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:32:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5712609da01d48709e1dbb3dc1ad940f',ramdisk_id='',reservation_id='r-28mr8u5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1849024285',owner_user_name='tempest-SnapshotDataIntegrityTests-1849024285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:32:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0cf05034c9c4fa4bf29de247f874f0b',uuid=5900f8a3-9336-4788-82d7-a30270bbb218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Converting VIF {"id": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "address": "fa:16:3e:87:af:33", "network": {"id": "9cf0c8c4-d97a-4522-b8e8-171dea409068", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-107925581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5712609da01d48709e1dbb3dc1ad940f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3d5b29-94", "ovs_interfaceid": "2a3d5b29-9478-4a00-bbab-c2db14e1ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:af:33,bridge_name='br-int',has_traffic_filtering=True,id=2a3d5b29-9478-4a00-bbab-c2db14e1ec5b,network=Network(9cf0c8c4-d97a-4522-b8e8-171dea409068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3d5b29-94') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG os_vif [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:af:33,bridge_name='br-int',has_traffic_filtering=True,id=2a3d5b29-9478-4a00-bbab-c2db14e1ec5b,network=Network(9cf0c8c4-d97a-4522-b8e8-171dea409068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3d5b29-94') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a3d5b29-94, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6d96197-aa37-4bb8-a17d-a74cce72c4a7) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:36 user nova-compute[75255]: INFO os_vif [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:af:33,bridge_name='br-int',has_traffic_filtering=True,id=2a3d5b29-9478-4a00-bbab-c2db14e1ec5b,network=Network(9cf0c8c4-d97a-4522-b8e8-171dea409068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3d5b29-94')
Nov 14 11:38:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Deleting instance files /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218_del
Nov 14 11:38:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Deletion of /opt/stack/data/nova/instances/5900f8a3-9336-4788-82d7-a30270bbb218_del complete
Nov 14 11:38:36 user nova-compute[75255]: INFO nova.compute.manager [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 11:38:36 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:38:36 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:38:37 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:38:37 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Took 1.02 seconds to deallocate network for instance.
Nov 14 11:38:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:38 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Deleted allocations for instance 5900f8a3-9336-4788-82d7-a30270bbb218
Nov 14 11:38:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6602605d-e1a2-4e6f-9c7e-3e72dbeb9c8a tempest-SnapshotDataIntegrityTests-1849024285 tempest-SnapshotDataIntegrityTests-1849024285-project-member] Lock "5900f8a3-9336-4788-82d7-a30270bbb218" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.289s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-9476cf0e-2294-474f-8a72-2970254dc521 req-d2bf2fb9-9d91-469a-929e-199eab8a2e44 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9476cf0e-2294-474f-8a72-2970254dc521 req-d2bf2fb9-9d91-469a-929e-199eab8a2e44 service nova] Acquiring lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9476cf0e-2294-474f-8a72-2970254dc521 req-d2bf2fb9-9d91-469a-929e-199eab8a2e44 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9476cf0e-2294-474f-8a72-2970254dc521 req-d2bf2fb9-9d91-469a-929e-199eab8a2e44 service nova] Lock "5900f8a3-9336-4788-82d7-a30270bbb218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-9476cf0e-2294-474f-8a72-2970254dc521 req-d2bf2fb9-9d91-469a-929e-199eab8a2e44 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] No waiting events found dispatching network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:38:38 user nova-compute[75255]: WARNING nova.compute.manager [req-9476cf0e-2294-474f-8a72-2970254dc521 req-d2bf2fb9-9d91-469a-929e-199eab8a2e44 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received unexpected event network-vif-plugged-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b for instance with vm_state deleted and task_state None.
Nov 14 11:38:38 user nova-compute[75255]: DEBUG nova.compute.manager [req-9476cf0e-2294-474f-8a72-2970254dc521 req-d2bf2fb9-9d91-469a-929e-199eab8a2e44 service nova] [instance: 5900f8a3-9336-4788-82d7-a30270bbb218] Received event network-vif-deleted-2a3d5b29-9478-4a00-bbab-c2db14e1ec5b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:38:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:43 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:46 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:54 user nova-compute[75255]: DEBUG nova.compute.manager [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-changed-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:38:54 user nova-compute[75255]: DEBUG nova.compute.manager [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Refreshing instance network info cache due to event network-changed-190f34c6-6ee1-4b8b-a548-0f18fec28b9d. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:38:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] Acquiring lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:38:54 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] Acquired lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:38:54 user nova-compute[75255]: DEBUG nova.network.neutron [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Refreshing network info cache for port 190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:38:55 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:55 user nova-compute[75255]: DEBUG nova.network.neutron [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updated VIF entry in instance network info cache for port 190f34c6-6ee1-4b8b-a548-0f18fec28b9d. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:38:55 user nova-compute[75255]: DEBUG nova.network.neutron [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updating instance_info_cache with network_info: [{"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:38:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2771dab1-5518-4376-a010-85bd1fb051f0 req-129713ad-476a-4982-82cf-95f7c64ae679 service nova] Releasing lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:38:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:38:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:57 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:38:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:38:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:39:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:39:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.027202606201172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance a80fddda-41de-44b8-bde3-9a60b7d8d732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance b71a1116-eb98-4c03-8eb7-71d5f11a5b81 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.180s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:39:00 user nova-compute[75255]: INFO nova.compute.claims [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Claim successful on node user
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:39:00 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.network.neutron [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:39:00 user nova-compute[75255]: INFO nova.virt.block_device [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Booting with volume snapshot d8ba2538-7389-40ae-91d4-b77b7329e8eb at /dev/vda
Nov 14 11:39:00 user nova-compute[75255]: DEBUG nova.policy [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99569798a7b14c20ab22ed26a0b11fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae08eed848f44bda5da3485b0b6b374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:39:01 user nova-compute[75255]: DEBUG nova.network.neutron [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Successfully created port: 41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:39:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:39:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:39:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.network.neutron [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Successfully updated port: 41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquired lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.network.neutron [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-changed-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Refreshing instance network info cache due to event network-changed-41dedabf-c261-4646-af73-de334bd4ece7. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] Acquiring lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.network.neutron [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.network.neutron [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Updating instance_info_cache with network_info: [{"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Releasing lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Instance network_info: |[{"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] Acquired lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Refreshing network info cache for port 41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Updated VIF entry in instance network info cache for port 41dedabf-c261-4646-af73-de334bd4ece7. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:39:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Updating instance_info_cache with network_info: [{"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:39:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-edd32fd3-3cd0-4995-8972-8cba1627d37e req-84d1fbdc-6d69-4f5d-9fd9-e5552d391436 service nova] Releasing lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:39:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG os_brick.utils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9a850-89e5-43b8-b4d1-c3a94fa5dec3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2313ffeb-5cb5-441f-8318-3cfde65bc3e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d433d-8edd-4243-bf9d-a34919d16169]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e238d-7094-4dbf-ab38-1ccdacda919f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:39:06 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:39:06 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf3730-9edd-4c79-8769-7f105c71aac0]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG os_brick.utils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:39:06 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Updating existing volume attachment record: 730f8c73-b963-456b-8b3a-a816f85645e7 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:39:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:39:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Creating image(s)
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Ensure instance console log exists: /opt/stack/data/nova/instances/b71a1116-eb98-4c03-8eb7-71d5f11a5b81/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Start _get_guest_xml network_info=[{"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T11:38:56Z,direct_url=<?>,disk_format='qcow2',id=0d444746-ee59-4929-ab59-13267b45a9d5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-315757591',owner='5ae08eed848f44bda5da3485b0b6b374',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T11:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '730f8c73-b963-456b-8b3a-a816f85645e7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZxgMdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b71a1116-eb98-4c03-8eb7-71d5f11a5b81', 'attached_at': '', 'detached_at': '', 'volume_id': 'b48823f2-d03b-45f5-a0d7-0d47fa9030b6', 'serial': 'b48823f2-d03b-45f5-a0d7-0d47fa9030b6'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:39:11 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:39:11 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T11:38:56Z,direct_url=<?>,disk_format='qcow2',id=0d444746-ee59-4929-ab59-13267b45a9d5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-315757591',owner='5ae08eed848f44bda5da3485b0b6b374',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T11:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZxgMdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:39:11 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:39:11 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:39:11 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4b7e75-87c7-48d1-9ea9-d91551056a1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:39:11 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[78330195-4c49-4ca5-984a-7993f404a086]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6] added
Nov 14 11:39:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[647661e8-b3bf-4b21-ab71-09ec84a4e709]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dab420-d267-4d64-a526-e350edde478d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyZxgMdC {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyZxgMdC" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b21dd-c30d-4e13-9958-f72c16faa1ce]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kyZxgMdC'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e614de37-ead0-4a20-b4c2-454711a838e0]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e4a6f-69c5-49da-a6a5-33e586ee7390]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:39:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:39:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acbe6fb-6f44-4899-9c80-8c2d02bf432d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260]
Nov 14 11:39:11 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260] successful.
Nov 14 11:39:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b23f6f-58a6-4b5b-b229-dcc63fa2e775]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3685a71-3923-4d96-8c1d-7f00dd51c343]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:39:11 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:39:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:39:11 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:39:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b401c3cd-df00-4d99-bc00-bea4337cbc6e]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:39:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZxgMdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26364316262326634', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364316262326634', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1321699753',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1321699753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1321699753',id=47,image_ref='0d444746-ee59-4929-ab59-13267b45a9d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJon6Ft3nFOSlDpZGT1qO29vDW/RZgOfVWG2CS/WbpaoS6Mh3rJ8sankZ+bos0s1IJKdAox1fI5kM4J9BTMsOX+wasZNRRDM+1mQO2LvSBXvdpyiDJnr2KSnK5emII81PA==',key_name='tempest-keypair-1608592660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-1188hb17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1575864965',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=b71a1116-eb98-4c03-8eb7-71d5f11a5b81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:28:05,bridge_name='br-int',has_traffic_filtering=True,id=41dedabf-c261-4646-af73-de334bd4ece7,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41dedabf-c2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'pci_devices' on Instance uuid b71a1116-eb98-4c03-8eb7-71d5f11a5b81 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:39:12 user nova-compute[75255]:   <uuid>b71a1116-eb98-4c03-8eb7-71d5f11a5b81</uuid>
Nov 14 11:39:12 user nova-compute[75255]:   <name>instance-0000002f</name>
Nov 14 11:39:12 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:39:12 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:39:12 user nova-compute[75255]:   <metadata>
Nov 14 11:39:12 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:39:12 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:39:12 user nova-compute[75255]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1321699753</nova:name>
Nov 14 11:39:12 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:39:11</nova:creationTime>
Nov 14 11:39:12 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:39:12 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:39:12 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:39:12 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:39:12 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:39:12 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:39:12 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:39:12 user nova-compute[75255]:       <nova:owner>
Nov 14 11:39:12 user nova-compute[75255]:         <nova:user uuid="99569798a7b14c20ab22ed26a0b11fd2">tempest-TestVolumeBootPattern-1575864965-project-member</nova:user>
Nov 14 11:39:12 user nova-compute[75255]:         <nova:project uuid="5ae08eed848f44bda5da3485b0b6b374">tempest-TestVolumeBootPattern-1575864965</nova:project>
Nov 14 11:39:12 user nova-compute[75255]:       </nova:owner>
Nov 14 11:39:12 user nova-compute[75255]:       <nova:root type="image" uuid="0d444746-ee59-4929-ab59-13267b45a9d5"/>
Nov 14 11:39:12 user nova-compute[75255]:       <nova:ports>
Nov 14 11:39:12 user nova-compute[75255]:         <nova:port uuid="41dedabf-c261-4646-af73-de334bd4ece7">
Nov 14 11:39:12 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:39:12 user nova-compute[75255]:         </nova:port>
Nov 14 11:39:12 user nova-compute[75255]:       </nova:ports>
Nov 14 11:39:12 user nova-compute[75255]:     </nova:instance>
Nov 14 11:39:12 user nova-compute[75255]:   </metadata>
Nov 14 11:39:12 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:39:12 user nova-compute[75255]:     <system>
Nov 14 11:39:12 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:39:12 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:39:12 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:39:12 user nova-compute[75255]:       <entry name="serial">b71a1116-eb98-4c03-8eb7-71d5f11a5b81</entry>
Nov 14 11:39:12 user nova-compute[75255]:       <entry name="uuid">b71a1116-eb98-4c03-8eb7-71d5f11a5b81</entry>
Nov 14 11:39:12 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:39:12 user nova-compute[75255]:     </system>
Nov 14 11:39:12 user nova-compute[75255]:   </sysinfo>
Nov 14 11:39:12 user nova-compute[75255]:   <os>
Nov 14 11:39:12 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:39:12 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:39:12 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:39:12 user nova-compute[75255]:   </os>
Nov 14 11:39:12 user nova-compute[75255]:   <features>
Nov 14 11:39:12 user nova-compute[75255]:     <acpi/>
Nov 14 11:39:12 user nova-compute[75255]:     <apic/>
Nov 14 11:39:12 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:39:12 user nova-compute[75255]:   </features>
Nov 14 11:39:12 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:39:12 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:39:12 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:39:12 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:39:12 user nova-compute[75255]:   </clock>
Nov 14 11:39:12 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:39:12 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:39:12 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:39:12 user nova-compute[75255]:   </cpu>
Nov 14 11:39:12 user nova-compute[75255]:   <devices>
Nov 14 11:39:12 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:39:12 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:39:12 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:39:12 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:39:12 user nova-compute[75255]:       <serial>b48823f2-d03b-45f5-a0d7-0d47fa9030b6</serial>
Nov 14 11:39:12 user nova-compute[75255]:     </disk>
Nov 14 11:39:12 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:39:12 user nova-compute[75255]:       <mac address="fa:16:3e:a6:28:05"/>
Nov 14 11:39:12 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:39:12 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:39:12 user nova-compute[75255]:       <target dev="tap41dedabf-c2"/>
Nov 14 11:39:12 user nova-compute[75255]:     </interface>
Nov 14 11:39:12 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:39:12 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/b71a1116-eb98-4c03-8eb7-71d5f11a5b81/console.log" append="off"/>
Nov 14 11:39:12 user nova-compute[75255]:     </serial>
Nov 14 11:39:12 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:39:12 user nova-compute[75255]:     <video>
Nov 14 11:39:12 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:39:12 user nova-compute[75255]:     </video>
Nov 14 11:39:12 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:39:12 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:39:12 user nova-compute[75255]:     </rng>
Nov 14 11:39:12 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:39:12 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:39:12 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:39:12 user nova-compute[75255]:     </memballoon>
Nov 14 11:39:12 user nova-compute[75255]:   </devices>
Nov 14 11:39:12 user nova-compute[75255]: </domain>
Nov 14 11:39:12 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1321699753',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1321699753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1321699753',id=47,image_ref='0d444746-ee59-4929-ab59-13267b45a9d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJon6Ft3nFOSlDpZGT1qO29vDW/RZgOfVWG2CS/WbpaoS6Mh3rJ8sankZ+bos0s1IJKdAox1fI5kM4J9BTMsOX+wasZNRRDM+1mQO2LvSBXvdpyiDJnr2KSnK5emII81PA==',key_name='tempest-keypair-1608592660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-1188hb17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1575864965',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=b71a1116-eb98-4c03-8eb7-71d5f11a5b81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:28:05,bridge_name='br-int',has_traffic_filtering=True,id=41dedabf-c261-4646-af73-de334bd4ece7,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41dedabf-c2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG os_vif [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:28:05,bridge_name='br-int',has_traffic_filtering=True,id=41dedabf-c261-4646-af73-de334bd4ece7,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41dedabf-c2') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a0f3baf-a56a-50db-a8b7-121f408d26ff', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41dedabf-c2, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41dedabf-c2, col_values=(('qos', UUID('995d3eac-a150-4e78-a485-3c3e3859760f')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41dedabf-c2, col_values=(('external_ids', {'iface-id': '41dedabf-c261-4646-af73-de334bd4ece7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:28:05', 'vm-uuid': 'b71a1116-eb98-4c03-8eb7-71d5f11a5b81'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:12 user nova-compute[75255]: INFO os_vif [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:28:05,bridge_name='br-int',has_traffic_filtering=True,id=41dedabf-c261-4646-af73-de334bd4ece7,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41dedabf-c2')
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:39:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No VIF found with MAC fa:16:3e:a6:28:05, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:39:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-fed9ac24-52dc-4bad-92ef-a2c8ee12bd16 req-0aa54cbc-4cb3-4d0c-b954-407e135d6e28 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:39:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fed9ac24-52dc-4bad-92ef-a2c8ee12bd16 req-0aa54cbc-4cb3-4d0c-b954-407e135d6e28 service nova] Acquiring lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:39:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fed9ac24-52dc-4bad-92ef-a2c8ee12bd16 req-0aa54cbc-4cb3-4d0c-b954-407e135d6e28 service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:39:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fed9ac24-52dc-4bad-92ef-a2c8ee12bd16 req-0aa54cbc-4cb3-4d0c-b954-407e135d6e28 service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:39:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-fed9ac24-52dc-4bad-92ef-a2c8ee12bd16 req-0aa54cbc-4cb3-4d0c-b954-407e135d6e28 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] No waiting events found dispatching network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:39:14 user nova-compute[75255]: WARNING nova.compute.manager [req-fed9ac24-52dc-4bad-92ef-a2c8ee12bd16 req-0aa54cbc-4cb3-4d0c-b954-407e135d6e28 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received unexpected event network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 for instance with vm_state building and task_state spawning.
Nov 14 11:39:14 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:39:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Instance spawned successfully.
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:39:16 user nova-compute[75255]: INFO nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:39:16 user nova-compute[75255]: INFO nova.compute.manager [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Took 15.87 seconds to build instance.
Nov 14 11:39:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-deae0928-e4ee-40e9-ae8d-4732e6c97232 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.969s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-4c4e174e-a506-4668-9844-83b76f5baa0e req-347e02bf-66ad-43c3-add6-e57075f49bf7 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4c4e174e-a506-4668-9844-83b76f5baa0e req-347e02bf-66ad-43c3-add6-e57075f49bf7 service nova] Acquiring lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4c4e174e-a506-4668-9844-83b76f5baa0e req-347e02bf-66ad-43c3-add6-e57075f49bf7 service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4c4e174e-a506-4668-9844-83b76f5baa0e req-347e02bf-66ad-43c3-add6-e57075f49bf7 service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:39:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-4c4e174e-a506-4668-9844-83b76f5baa0e req-347e02bf-66ad-43c3-add6-e57075f49bf7 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] No waiting events found dispatching network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:39:16 user nova-compute[75255]: WARNING nova.compute.manager [req-4c4e174e-a506-4668-9844-83b76f5baa0e req-347e02bf-66ad-43c3-add6-e57075f49bf7 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received unexpected event network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 for instance with vm_state active and task_state None.
Nov 14 11:39:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:39:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:39:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:39:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:39:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:39:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:39:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:39:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:39:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:39:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:39:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:39:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:58 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:39:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:40:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.024456024169922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 1083ad03-03f0-4909-b588-c7133d8da973 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance a80fddda-41de-44b8-bde3-9a60b7d8d732 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance b71a1116-eb98-4c03-8eb7-71d5f11a5b81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:40:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:40:03 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:40:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:40:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:40:03 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:40:03 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 1083ad03-03f0-4909-b588-c7133d8da973 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:40:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updating instance_info_cache with network_info: [{"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:40:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-1083ad03-03f0-4909-b588-c7133d8da973" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:40:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:40:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:40:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:40:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:40:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-changed-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Refreshing instance network info cache due to event network-changed-66e9baab-8248-4e5e-aec3-d0745bfaebec. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:40:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:40:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:40:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Refreshing network info cache for port 66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:40:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:15 user nova-compute[75255]: DEBUG nova.network.neutron [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updated VIF entry in instance network info cache for port 66e9baab-8248-4e5e-aec3-d0745bfaebec. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:40:15 user nova-compute[75255]: DEBUG nova.network.neutron [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:40:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-648ca98a-57d7-4f65-8488-df60f2b21351 req-0652ef9a-1f6c-422e-81dc-2dff3a5b29db service nova] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:40:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:40:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:18 user nova-compute[75255]: INFO nova.compute.manager [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Attaching volume f80e2dde-7377-4198-853e-c5da8bac8ed1 to /dev/vdb
Nov 14 11:40:18 user nova-compute[75255]: DEBUG os_brick.utils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[98010205-0e9b-4f5b-812e-580cf9e5f097]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[21271ffe-7527-4be9-a1a5-5d0e19ace520]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f220f6-e38b-4f2f-9635-f7075b45b39c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5213dd33-29bd-418a-a59b-b8b78b53380d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:40:18 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:40:18 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d124fd9-b850-40f5-80b8-9fe763de1b12]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG os_brick.utils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:40:18 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating existing volume attachment record: 5cf6b865-9002-400a-ba80-746b0124e5d1 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:40:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANtdChTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:40:22 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:40:22 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:40:22 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be004b6-c832-434a-bc50-d132d1260e4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:40:22 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a329b9e3-c191-4ea6-b958-f4697769c4ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1] added
Nov 14 11:40:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2655389b-66ab-46e2-a196-9cd271b0135d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb3b3c-8b1a-4297-9a06-705c644cb1fd]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANtdChTO {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANtdChTO" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc6e2e9-e340-454e-affe-1dea588feec6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANtdChTO'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d5096-71e9-4530-a200-1cd0e4abe4c4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e0ba3c-7abc-4082-8091-b8fcde7c04b0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac86b150-90f7-45f8-8000-aecdab38e307]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]
Nov 14 11:40:22 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.
Nov 14 11:40:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be1afc6-b7d2-4a62-b863-dd496bbb8116]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[610b6dc2-06b4-4f40-97c7-993078c981a6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:40:22 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a0a281-879c-43b0-8c32-1fb428ae669f]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:40:22 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANtdChTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:40:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:40:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26133666666653162', 'path': '/dev/sdd'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:40:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133666666653162', 'path': '/dev/sdd'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:40:23 user nova-compute[75255]: DEBUG nova.objects.instance [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:40:23 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:40:23 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:40:23 user nova-compute[75255]:   <source dev="/dev/sdd"/>
Nov 14 11:40:23 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:40:23 user nova-compute[75255]:   <serial>f80e2dde-7377-4198-853e-c5da8bac8ed1</serial>
Nov 14 11:40:23 user nova-compute[75255]: </disk>
Nov 14 11:40:23 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No VIF found with MAC fa:16:3e:0b:ec:8e, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-bdbb426f-bac4-48fc-957a-130ee10137e8 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.198s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9d2fa5d5-ff8a-43aa-bc3c-77d0f47009ae tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9d2fa5d5-ff8a-43aa-bc3c-77d0f47009ae tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9d2fa5d5-ff8a-43aa-bc3c-77d0f47009ae tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9d2fa5d5-ff8a-43aa-bc3c-77d0f47009ae tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75255) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-9d2fa5d5-ff8a-43aa-bc3c-77d0f47009ae tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:24 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-e6774c77-7513-4e46-8de2-6bfba21e0018 req-637fb205-4eda-4151-aef5-e28696313c98 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e6774c77-7513-4e46-8de2-6bfba21e0018 req-637fb205-4eda-4151-aef5-e28696313c98 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e6774c77-7513-4e46-8de2-6bfba21e0018 req-637fb205-4eda-4151-aef5-e28696313c98 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e6774c77-7513-4e46-8de2-6bfba21e0018 req-637fb205-4eda-4151-aef5-e28696313c98 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-e6774c77-7513-4e46-8de2-6bfba21e0018 req-637fb205-4eda-4151-aef5-e28696313c98 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:40:25 user nova-compute[75255]: WARNING nova.compute.manager [req-e6774c77-7513-4e46-8de2-6bfba21e0018 req-637fb205-4eda-4151-aef5-e28696313c98 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state active and task_state powering-off.
Nov 14 11:40:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance destroyed successfully.
Nov 14 11:40:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-9d2fa5d5-ff8a-43aa-bc3c-77d0f47009ae tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:40:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-9d2fa5d5-ff8a-43aa-bc3c-77d0f47009ae tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.843s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-890b313b-9983-4b23-bc7a-922e682ce431 req-6fcd2ca5-0e0c-4df1-9531-4b7ab4fe4fe5 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-890b313b-9983-4b23-bc7a-922e682ce431 req-6fcd2ca5-0e0c-4df1-9531-4b7ab4fe4fe5 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-890b313b-9983-4b23-bc7a-922e682ce431 req-6fcd2ca5-0e0c-4df1-9531-4b7ab4fe4fe5 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-890b313b-9983-4b23-bc7a-922e682ce431 req-6fcd2ca5-0e0c-4df1-9531-4b7ab4fe4fe5 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:27 user nova-compute[75255]: DEBUG nova.compute.manager [req-890b313b-9983-4b23-bc7a-922e682ce431 req-6fcd2ca5-0e0c-4df1-9531-4b7ab4fe4fe5 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:40:27 user nova-compute[75255]: WARNING nova.compute.manager [req-890b313b-9983-4b23-bc7a-922e682ce431 req-6fcd2ca5-0e0c-4df1-9531-4b7ab4fe4fe5 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state stopped and task_state None.
Nov 14 11:40:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:44 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-changed-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG nova.compute.manager [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Refreshing instance network info cache due to event network-changed-41dedabf-c261-4646-af73-de334bd4ece7. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] Acquiring lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] Acquired lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Refreshing network info cache for port 41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Updated VIF entry in instance network info cache for port 41dedabf-c261-4646-af73-de334bd4ece7. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG nova.network.neutron [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Updating instance_info_cache with network_info: [{"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:40:51 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-72d05fa5-eb9c-424d-855e-9b9242291c47 req-d4d2d7ac-8d23-48bb-8c02-f76a9db75548 service nova] Releasing lock "refresh_cache-b71a1116-eb98-4c03-8eb7-71d5f11a5b81" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "1083ad03-03f0-4909-b588-c7133d8da973" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:52 user nova-compute[75255]: INFO nova.compute.manager [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Terminating instance
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Instance destroyed successfully.
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lazy-loading 'resources' on Instance uuid 1083ad03-03f0-4909-b588-c7133d8da973 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1948448393',display_name='tempest-ServersNegativeTestJSON-server-1948448393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1948448393',id=41,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:32:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242dd529d2bc43f1bcc1e2feae480b64',ramdisk_id='',reservation_id='r-fkwydm9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1020604939',owner_user_name='tempest-ServersNegativeTestJSON-1020604939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:32:18Z,user_data=None,user_id='2abf6da5049d4bc2a677ffa7d6cee58a',uuid=1083ad03-03f0-4909-b588-c7133d8da973,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converting VIF {"id": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "address": "fa:16:3e:b9:1f:ff", "network": {"id": "68b62e80-deb4-4940-bc27-232a429c5af0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-375598618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242dd529d2bc43f1bcc1e2feae480b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872e9c09-db", "ovs_interfaceid": "872e9c09-db9a-46ea-8152-4f135f9e8f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=872e9c09-db9a-46ea-8152-4f135f9e8f02,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872e9c09-db') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG os_vif [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=872e9c09-db9a-46ea-8152-4f135f9e8f02,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872e9c09-db') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap872e9c09-db, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1609059e-6936-4226-b0d3-7292e06f5a84) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:52 user nova-compute[75255]: INFO os_vif [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=872e9c09-db9a-46ea-8152-4f135f9e8f02,network=Network(68b62e80-deb4-4940-bc27-232a429c5af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872e9c09-db')
Nov 14 11:40:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Deleting instance files /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973_del
Nov 14 11:40:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Deletion of /opt/stack/data/nova/instances/1083ad03-03f0-4909-b588-c7133d8da973_del complete
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:52 user nova-compute[75255]: INFO nova.compute.manager [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Terminating instance
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:40:52 user nova-compute[75255]: INFO nova.compute.manager [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 14 11:40:52 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:40:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-be1a152c-acb3-4a0a-970c-13f680f547dd req-04a9d47d-9f15-4614-819c-46400bf3515b service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-vif-unplugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-be1a152c-acb3-4a0a-970c-13f680f547dd req-04a9d47d-9f15-4614-819c-46400bf3515b service nova] Acquiring lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-be1a152c-acb3-4a0a-970c-13f680f547dd req-04a9d47d-9f15-4614-819c-46400bf3515b service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-be1a152c-acb3-4a0a-970c-13f680f547dd req-04a9d47d-9f15-4614-819c-46400bf3515b service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-be1a152c-acb3-4a0a-970c-13f680f547dd req-04a9d47d-9f15-4614-819c-46400bf3515b service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] No waiting events found dispatching network-vif-unplugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-be1a152c-acb3-4a0a-970c-13f680f547dd req-04a9d47d-9f15-4614-819c-46400bf3515b service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-vif-unplugged-41dedabf-c261-4646-af73-de334bd4ece7 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received event network-vif-unplugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] No waiting events found dispatching network-vif-unplugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received event network-vif-unplugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received event network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] Acquiring lock "1083ad03-03f0-4909-b588-c7133d8da973-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] Lock "1083ad03-03f0-4909-b588-c7133d8da973-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.manager [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] No waiting events found dispatching network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:40:53 user nova-compute[75255]: WARNING nova.compute.manager [req-02d75eb1-ec05-47f1-82dc-c6e6f38e4804 req-7d61dc65-1e08-4662-b850-198d2e742bc5 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received unexpected event network-vif-plugged-872e9c09-db9a-46ea-8152-4f135f9e8f02 for instance with vm_state active and task_state deleting.
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:40:53 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Took 0.52 seconds to deallocate network for instance.
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:40:53 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Instance destroyed successfully.
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.objects.instance [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'resources' on Instance uuid b71a1116-eb98-4c03-8eb7-71d5f11a5b81 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1321699753',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1321699753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1321699753',id=47,image_ref='0d444746-ee59-4929-ab59-13267b45a9d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJon6Ft3nFOSlDpZGT1qO29vDW/RZgOfVWG2CS/WbpaoS6Mh3rJ8sankZ+bos0s1IJKdAox1fI5kM4J9BTMsOX+wasZNRRDM+1mQO2LvSBXvdpyiDJnr2KSnK5emII81PA==',key_name='tempest-keypair-1608592660',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:39:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-1188hb17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1575864965',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=b71a1116-eb98-4c03-8eb7-71d5f11a5b81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "41dedabf-c261-4646-af73-de334bd4ece7", "address": "fa:16:3e:a6:28:05", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41dedabf-c2", "ovs_interfaceid": "41dedabf-c261-4646-af73-de334bd4ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:28:05,bridge_name='br-int',has_traffic_filtering=True,id=41dedabf-c261-4646-af73-de334bd4ece7,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41dedabf-c2') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_vif [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:28:05,bridge_name='br-int',has_traffic_filtering=True,id=41dedabf-c261-4646-af73-de334bd4ece7,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41dedabf-c2') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41dedabf-c2, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=995d3eac-a150-4e78-a485-3c3e3859760f) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:53 user nova-compute[75255]: INFO os_vif [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:28:05,bridge_name='br-int',has_traffic_filtering=True,id=41dedabf-c261-4646-af73-de334bd4ece7,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41dedabf-c2')
Nov 14 11:40:53 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZxgMdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:40:53 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c053a-c462-44a1-8f9f-fd68ba225fd1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:40:53 user nova-compute[75255]: No targets found.
Nov 14 11:40:53 user nova-compute[75255]: iSNS:
Nov 14 11:40:53 user nova-compute[75255]: No targets found.
Nov 14 11:40:53 user nova-compute[75255]: STATIC:
Nov 14 11:40:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750
Nov 14 11:40:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:40:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:40:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6
Nov 14 11:40:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:40:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:40:53 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1
Nov 14 11:40:53 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:40:53 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:40:53 user nova-compute[75255]: FIRMWARE:
Nov 14 11:40:53 user nova-compute[75255]: No targets found.
Nov 14 11:40:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:40:53 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:40:53 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Deleted allocations for instance 1083ad03-03f0-4909-b588-c7133d8da973
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1665bc82-d09c-4645-94ff-abd4b2da2ff5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea55d5ea-8873-46b8-a6b1-ac8d89d61587]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:40:53 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:40:53 user nova-compute[75255]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:40:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:40:53 user nova-compute[75255]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 (non-flash)
Nov 14 11:40:53 user nova-compute[75255]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:40:53 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30876c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916942d-b010-42b0-abeb-b3e54ffd570d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f8ecf-5a41-49ab-9746-c353b855f406]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5a0f16cb-abcf-4a83-ab78-2925556144d7 tempest-ServersNegativeTestJSON-1020604939 tempest-ServersNegativeTestJSON-1020604939-project-member] Lock "1083ad03-03f0-4909-b588-c7133d8da973" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.661s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0374eba6-bd84-494f-b4c5-803531257e8f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29458d8-7153-4bda-badb-4aef32885def]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36460a0-f1d5-4026-9cb9-031be5f09c39]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:53 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7a40cc-867f-4be3-a776-7ac859192418]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260]
Nov 14 11:40:54 user nova-compute[75255]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6, portal: 172.16.0.220,3260] successful.
Nov 14 11:40:54 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48823f2-d03b-45f5-a0d7-0d47fa9030b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a3945a-8204-4079-94ba-84db7da73adf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== disconnect_volume: return (332ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:40:54 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Deleting instance files /opt/stack/data/nova/instances/b71a1116-eb98-4c03-8eb7-71d5f11a5b81_del
Nov 14 11:40:54 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Deletion of /opt/stack/data/nova/instances/b71a1116-eb98-4c03-8eb7-71d5f11a5b81_del complete
Nov 14 11:40:54 user nova-compute[75255]: INFO nova.compute.manager [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 11:40:54 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:40:54 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:40:54 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Took 0.70 seconds to deallocate network for instance.
Nov 14 11:40:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-2c5b8c3f-ce5f-4d6d-9367-0659bdd9214e req-60b66ffd-d1f5-44d8-8a1c-cb0be1c07f72 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2c5b8c3f-ce5f-4d6d-9367-0659bdd9214e req-60b66ffd-d1f5-44d8-8a1c-cb0be1c07f72 service nova] Acquiring lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2c5b8c3f-ce5f-4d6d-9367-0659bdd9214e req-60b66ffd-d1f5-44d8-8a1c-cb0be1c07f72 service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2c5b8c3f-ce5f-4d6d-9367-0659bdd9214e req-60b66ffd-d1f5-44d8-8a1c-cb0be1c07f72 service nova] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-2c5b8c3f-ce5f-4d6d-9367-0659bdd9214e req-60b66ffd-d1f5-44d8-8a1c-cb0be1c07f72 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] No waiting events found dispatching network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:40:55 user nova-compute[75255]: WARNING nova.compute.manager [req-2c5b8c3f-ce5f-4d6d-9367-0659bdd9214e req-60b66ffd-d1f5-44d8-8a1c-cb0be1c07f72 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received unexpected event network-vif-plugged-41dedabf-c261-4646-af73-de334bd4ece7 for instance with vm_state active and task_state deleting.
Nov 14 11:40:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-23e8145a-2a5e-4073-b6bd-94db3e7865dc req-79cf7c6f-7397-4023-ac47-edb495b36528 service nova] [instance: 1083ad03-03f0-4909-b588-c7133d8da973] Received event network-vif-deleted-872e9c09-db9a-46ea-8152-4f135f9e8f02 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG nova.compute.manager [req-23e8145a-2a5e-4073-b6bd-94db3e7865dc req-79cf7c6f-7397-4023-ac47-edb495b36528 service nova] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Received event network-vif-deleted-41dedabf-c261-4646-af73-de334bd4ece7 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:40:55 user nova-compute[75255]: INFO nova.compute.manager [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 11:40:55 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: b71a1116-eb98-4c03-8eb7-71d5f11a5b81] Deleting volume: b48823f2-d03b-45f5-a0d7-0d47fa9030b6 {{(pid=75255) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:40:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:55 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Deleted allocations for instance b71a1116-eb98-4c03-8eb7-71d5f11a5b81
Nov 14 11:40:55 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c4d3c043-69b9-47a5-bf0e-7c2225c4a838 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "b71a1116-eb98-4c03-8eb7-71d5f11a5b81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:40:59 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:40:59 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.050796508789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance a80fddda-41de-44b8-bde3-9a60b7d8d732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:40:59 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:41:00 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:41:00 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:41:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:41:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:41:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updating instance_info_cache with network_info: [{"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-a80fddda-41de-44b8-bde3-9a60b7d8d732" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:41:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:41:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:41:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:41:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:41:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:41:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "a80fddda-41de-44b8-bde3-9a60b7d8d732" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:41:44 user nova-compute[75255]: INFO nova.compute.manager [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Terminating instance
Nov 14 11:41:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-36fe3fa8-81c7-457f-9151-715ea4e2b16a req-4f253268-6784-4eed-b6c8-90a15733e5bc service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-vif-unplugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36fe3fa8-81c7-457f-9151-715ea4e2b16a req-4f253268-6784-4eed-b6c8-90a15733e5bc service nova] Acquiring lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36fe3fa8-81c7-457f-9151-715ea4e2b16a req-4f253268-6784-4eed-b6c8-90a15733e5bc service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-36fe3fa8-81c7-457f-9151-715ea4e2b16a req-4f253268-6784-4eed-b6c8-90a15733e5bc service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-36fe3fa8-81c7-457f-9151-715ea4e2b16a req-4f253268-6784-4eed-b6c8-90a15733e5bc service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] No waiting events found dispatching network-vif-unplugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:41:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-36fe3fa8-81c7-457f-9151-715ea4e2b16a req-4f253268-6784-4eed-b6c8-90a15733e5bc service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-vif-unplugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Instance destroyed successfully.
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.objects.instance [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'resources' on Instance uuid a80fddda-41de-44b8-bde3-9a60b7d8d732 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2088325150',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2088325150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2088325150',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOuiA/UZVpX3DQmaoD1tZxmIvSl48+EWQYuxzwsVzYI9ffxcKIQrM6v32MU7Pz/xm20K2DDt3G9y3D33nS7Dhf1DknWDmtdFfJrHc3lVnvDEptp4CZR4HTKc0bMIevrfg==',key_name='tempest-keypair-1186577102',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:37:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-ny2at8im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=a80fddda-41de-44b8-bde3-9a60b7d8d732,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "address": "fa:16:3e:7e:93:a4", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190f34c6-6e", "ovs_interfaceid": "190f34c6-6ee1-4b8b-a548-0f18fec28b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:93:a4,bridge_name='br-int',has_traffic_filtering=True,id=190f34c6-6ee1-4b8b-a548-0f18fec28b9d,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190f34c6-6e') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_vif [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:93:a4,bridge_name='br-int',has_traffic_filtering=True,id=190f34c6-6ee1-4b8b-a548-0f18fec28b9d,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190f34c6-6e') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap190f34c6-6e, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=299e9a36-df0b-40ff-957f-97a11a82cf93) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:45 user nova-compute[75255]: INFO os_vif [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:93:a4,bridge_name='br-int',has_traffic_filtering=True,id=190f34c6-6ee1-4b8b-a548-0f18fec28b9d,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190f34c6-6e')
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdinRkCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:41:45 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38472e21-9857-4118-a913-55e82ad982df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:41:45 user nova-compute[75255]: No targets found.
Nov 14 11:41:45 user nova-compute[75255]: iSNS:
Nov 14 11:41:45 user nova-compute[75255]: No targets found.
Nov 14 11:41:45 user nova-compute[75255]: STATIC:
Nov 14 11:41:45 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750
Nov 14 11:41:45 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:41:45 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:41:45 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1
Nov 14 11:41:45 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:41:45 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:41:45 user nova-compute[75255]: FIRMWARE:
Nov 14 11:41:45 user nova-compute[75255]: No targets found.
Nov 14 11:41:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:41:45 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:41:45 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03befe8-49a0-41ae-ae5e-af90d1d8e379]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3f32e5-2be4-49e1-a948-603cae66f4a5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:41:45 user nova-compute[75255]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:41:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 (non-flash)
Nov 14 11:41:45 user nova-compute[75255]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:41:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086983a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[806894fb-fd95-46ed-8536-857084d5ec3d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f57e41-c8da-4e63-b16f-a907458fac10]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d807493-dc10-476e-9a13-9dd7557e479c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed45232-bbdf-4e8e-b225-e37a419ea31e]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd01043-bd4f-4519-aef5-fbe1910494ef]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d6e152-3667-4099-ae6f-5cf9f84e0071]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260]
Nov 14 11:41:45 user nova-compute[75255]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750, portal: 172.16.0.220,3260] successful.
Nov 14 11:41:45 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba35372-78f7-474c-a6ca-c83ffa5f2750 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620ee8d-a551-479f-b9ef-f17447b5f644]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== disconnect_volume: return (316ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:41:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Deleting instance files /opt/stack/data/nova/instances/a80fddda-41de-44b8-bde3-9a60b7d8d732_del
Nov 14 11:41:45 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Deletion of /opt/stack/data/nova/instances/a80fddda-41de-44b8-bde3-9a60b7d8d732_del complete
Nov 14 11:41:45 user nova-compute[75255]: INFO nova.compute.manager [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 11:41:45 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:41:45 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:41:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-ba44fd52-486b-430b-86d4-c83dbc3d90e0 req-14df3460-7644-453a-8a44-bdc74335454a service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:41:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ba44fd52-486b-430b-86d4-c83dbc3d90e0 req-14df3460-7644-453a-8a44-bdc74335454a service nova] Acquiring lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:41:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ba44fd52-486b-430b-86d4-c83dbc3d90e0 req-14df3460-7644-453a-8a44-bdc74335454a service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:41:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-ba44fd52-486b-430b-86d4-c83dbc3d90e0 req-14df3460-7644-453a-8a44-bdc74335454a service nova] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:41:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-ba44fd52-486b-430b-86d4-c83dbc3d90e0 req-14df3460-7644-453a-8a44-bdc74335454a service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] No waiting events found dispatching network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:41:47 user nova-compute[75255]: WARNING nova.compute.manager [req-ba44fd52-486b-430b-86d4-c83dbc3d90e0 req-14df3460-7644-453a-8a44-bdc74335454a service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received unexpected event network-vif-plugged-190f34c6-6ee1-4b8b-a548-0f18fec28b9d for instance with vm_state active and task_state deleting.
Nov 14 11:41:47 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:41:47 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Took 1.40 seconds to deallocate network for instance.
Nov 14 11:41:47 user nova-compute[75255]: DEBUG nova.compute.manager [req-61a50b6b-3a10-45e5-a87a-e32dbbfd1e4e req-a947e087-4913-4cc7-82b1-7c552062a006 service nova] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Received event network-vif-deleted-190f34c6-6ee1-4b8b-a548-0f18fec28b9d {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:41:47 user nova-compute[75255]: INFO nova.compute.manager [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 11:41:47 user nova-compute[75255]: DEBUG nova.compute.manager [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: a80fddda-41de-44b8-bde3-9a60b7d8d732] Deleting volume: 9ba35372-78f7-474c-a6ca-c83ffa5f2750 {{(pid=75255) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 11:41:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:41:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:41:48 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:41:48 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:41:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:41:48 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Deleted allocations for instance a80fddda-41de-44b8-bde3-9a60b7d8d732
Nov 14 11:41:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-034b8548-4fe6-4763-9fd4-27d8bd322703 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "a80fddda-41de-44b8-bde3-9a60b7d8d732" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.742s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:41:50 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:41:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:41:59 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:42:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:42:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:42:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9112MB free_disk=25.04907989501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:42:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:42:01 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:42:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:42:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:42:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:42:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:42:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:42:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:42:15 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:42:15 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'info_cache' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:15 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:42:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance destroyed successfully.
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'resources' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_vif [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66e9baab-82, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6ff21bd-2f2a-4949-967b-816fcd9813b9) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:16 user nova-compute[75255]: INFO os_vif [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82')
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANtdChTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:42:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[674df4b0-c8d5-46be-b387-0a6b1f48cfcc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:42:16 user nova-compute[75255]: No targets found.
Nov 14 11:42:16 user nova-compute[75255]: iSNS:
Nov 14 11:42:16 user nova-compute[75255]: No targets found.
Nov 14 11:42:16 user nova-compute[75255]: STATIC:
Nov 14 11:42:16 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1
Nov 14 11:42:16 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:42:16 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:42:16 user nova-compute[75255]: FIRMWARE:
Nov 14 11:42:16 user nova-compute[75255]: No targets found.
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:42:16 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:42:16 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba3cc93-9ee5-4e3a-b873-b459f75b2c7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dab9f2-bf74-458e-9ad3-39ee685a60f4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1'): ({'sdd'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Removing single pathed devices sdd {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b427605e-7128-400e-a5ab-ec5be66e7dd8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa3dfc8-f121-4a3a-ac69-d37fdf6d9a36]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flushing IO for device /dev/sdd {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[58086260-d109-4f74-8523-df911fc9b929]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbefce3-4e66-4828-94ba-a995aaae7a07]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] SCSI volumes sdd have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[28390365-0f4b-4044-b29d-0ff4d657cb61]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[35846168-5897-41f5-ac14-3f6816188146]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]
Nov 14 11:42:16 user nova-compute[75255]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aea7e8-fc11-48bb-90c2-a81cc28eeac0]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== disconnect_volume: return (276ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Start _get_guest_xml network_info=[{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '5cf6b865-9002-400a-ba80-746b0124e5d1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANtdChTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3e0a66b6-b8ef-4804-8197-39eaa11bed2b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f80e2dde-7377-4198-853e-c5da8bac8ed1', 'serial': 'f80e2dde-7377-4198-853e-c5da8bac8ed1'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'numa_topology' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:42:16 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:42:16 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANtdChTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:42:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:42:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:42:16 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3b7a76-74a8-41d5-967b-acc4bbd520c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:42:16 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[218142c6-7c64-4418-ae27-7312679bda79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1] added
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[601468b4-0253-4fe6-9669-f9585bf271ec]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda7d38-5ee8-4a1c-98ee-03569c46c358]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANtdChTO {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANtdChTO" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bcf452-157d-4958-b8ba-1ecc72f412ef]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANtdChTO'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[24695de5-8a4d-456e-a54b-ec9b147b8699]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6e0b2b-e9f2-4004-bca4-75491e7b167d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:42:16 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:42:16 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:42:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:42:16 user nova-compute[75255]: 
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[835d6f0c-2672-48ec-b420-06bda340a263]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]
Nov 14 11:42:16 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8effc03-3e1d-4174-b47d-6c81d13794d2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[28292fa8-cfd9-4e55-83b6-3a2f5899893c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[96175566-2bfd-4cd3-8511-0703b6c83990]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:42:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANtdChTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26133666666653162', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133666666653162', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:42:17 user nova-compute[75255]:   <uuid>3e0a66b6-b8ef-4804-8197-39eaa11bed2b</uuid>
Nov 14 11:42:17 user nova-compute[75255]:   <name>instance-0000002e</name>
Nov 14 11:42:17 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:42:17 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:42:17 user nova-compute[75255]:   <metadata>
Nov 14 11:42:17 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:42:17 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:42:17 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeTestJSON-server-1911577971</nova:name>
Nov 14 11:42:17 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:42:16</nova:creationTime>
Nov 14 11:42:17 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:42:17 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:42:17 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:42:17 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:42:17 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:42:17 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:42:17 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:42:17 user nova-compute[75255]:       <nova:owner>
Nov 14 11:42:17 user nova-compute[75255]:         <nova:user uuid="d508f30ed89a4451a0a383019d98dae4">tempest-AttachVolumeTestJSON-545907524-project-member</nova:user>
Nov 14 11:42:17 user nova-compute[75255]:         <nova:project uuid="f32711b26ee74011b2733543d7c60c81">tempest-AttachVolumeTestJSON-545907524</nova:project>
Nov 14 11:42:17 user nova-compute[75255]:       </nova:owner>
Nov 14 11:42:17 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:42:17 user nova-compute[75255]:       <nova:ports>
Nov 14 11:42:17 user nova-compute[75255]:         <nova:port uuid="66e9baab-8248-4e5e-aec3-d0745bfaebec">
Nov 14 11:42:17 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:42:17 user nova-compute[75255]:         </nova:port>
Nov 14 11:42:17 user nova-compute[75255]:       </nova:ports>
Nov 14 11:42:17 user nova-compute[75255]:     </nova:instance>
Nov 14 11:42:17 user nova-compute[75255]:   </metadata>
Nov 14 11:42:17 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:42:17 user nova-compute[75255]:     <system>
Nov 14 11:42:17 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:42:17 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:42:17 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:42:17 user nova-compute[75255]:       <entry name="serial">3e0a66b6-b8ef-4804-8197-39eaa11bed2b</entry>
Nov 14 11:42:17 user nova-compute[75255]:       <entry name="uuid">3e0a66b6-b8ef-4804-8197-39eaa11bed2b</entry>
Nov 14 11:42:17 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:42:17 user nova-compute[75255]:     </system>
Nov 14 11:42:17 user nova-compute[75255]:   </sysinfo>
Nov 14 11:42:17 user nova-compute[75255]:   <os>
Nov 14 11:42:17 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:42:17 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:42:17 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:42:17 user nova-compute[75255]:   </os>
Nov 14 11:42:17 user nova-compute[75255]:   <features>
Nov 14 11:42:17 user nova-compute[75255]:     <acpi/>
Nov 14 11:42:17 user nova-compute[75255]:     <apic/>
Nov 14 11:42:17 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:42:17 user nova-compute[75255]:   </features>
Nov 14 11:42:17 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:42:17 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:42:17 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:42:17 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:42:17 user nova-compute[75255]:   </clock>
Nov 14 11:42:17 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:42:17 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:42:17 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:42:17 user nova-compute[75255]:   </cpu>
Nov 14 11:42:17 user nova-compute[75255]:   <devices>
Nov 14 11:42:17 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:42:17 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:42:17 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk"/>
Nov 14 11:42:17 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:42:17 user nova-compute[75255]:     </disk>
Nov 14 11:42:17 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:42:17 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:42:17 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:42:17 user nova-compute[75255]:       <target dev="vdb" bus="virtio"/>
Nov 14 11:42:17 user nova-compute[75255]:       <serial>f80e2dde-7377-4198-853e-c5da8bac8ed1</serial>
Nov 14 11:42:17 user nova-compute[75255]:     </disk>
Nov 14 11:42:17 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:42:17 user nova-compute[75255]:       <mac address="fa:16:3e:0b:ec:8e"/>
Nov 14 11:42:17 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:42:17 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:42:17 user nova-compute[75255]:       <target dev="tap66e9baab-82"/>
Nov 14 11:42:17 user nova-compute[75255]:     </interface>
Nov 14 11:42:17 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:42:17 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/console.log" append="off"/>
Nov 14 11:42:17 user nova-compute[75255]:     </serial>
Nov 14 11:42:17 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:42:17 user nova-compute[75255]:     <video>
Nov 14 11:42:17 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:42:17 user nova-compute[75255]:     </video>
Nov 14 11:42:17 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:42:17 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:42:17 user nova-compute[75255]:     </rng>
Nov 14 11:42:17 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:42:17 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:42:17 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:42:17 user nova-compute[75255]:     </memballoon>
Nov 14 11:42:17 user nova-compute[75255]:   </devices>
Nov 14 11:42:17 user nova-compute[75255]: </domain>
Nov 14 11:42:17 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Verify base images {{(pid=75255) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Image id 26cc9ab5-432f-4182-801c-11cab6c13c7e yields fingerprint fa86f4c53d6d25d0f34f4cef49c112a31300ff96 {{(pid=75255) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] image 26cc9ab5-432f-4182-801c-11cab6c13c7e at (/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96): checking
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] image 26cc9ab5-432f-4182-801c-11cab6c13c7e at (/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96): image is in use {{(pid=75255) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75255) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] 3e0a66b6-b8ef-4804-8197-39eaa11bed2b is a valid instance name {{(pid=75255) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] 3e0a66b6-b8ef-4804-8197-39eaa11bed2b has a disk file {{(pid=75255) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b is backed by fa86f4c53d6d25d0f34f4cef49c112a31300ff96 {{(pid=75255) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d
Nov 14 11:42:18 user nova-compute[75255]: WARNING nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Unknown base file: /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Active base files: /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Removable base files: /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95 /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0 /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934 /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1 /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3f9a071775ce85ca263461039288d821a0a7ff95
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0b96c7442cc02923f941baadb18a143bbd871e4b
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/49b0892d73b181f82de6eb4631148f55e06857a0
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e2012ce6e57e9c96668affdda3601d1f92b55d9f
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cdbf4f551ba331c76cda3a9147c1048a7010c934
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f74b7191827caf7e9d39f764aaf5590147a50de1
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/51b5fd386b1cc6c662a5226dfd9b429ec386bbaf
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/edf6da6276a4726ab7c25809c64ddad9d593342d
Nov 14 11:42:18 user nova-compute[75255]: INFO nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1a6733ef9ffd7a930fb267e280cb9d14d851d0d9
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Verification complete {{(pid=75255) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Verify swap images {{(pid=75255) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.imagecache [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Verify ephemeral images {{(pid=75255) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Cannot resize image /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.objects.instance [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'migration_context' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.objects.base [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG os_vif [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99d33761-5596-50ec-97be-01ec57d99ef1', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66e9baab-82, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66e9baab-82, col_values=(('qos', UUID('9bff9547-6cde-4d5c-b570-15f31cc4d31e')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66e9baab-82, col_values=(('external_ids', {'iface-id': '66e9baab-8248-4e5e-aec3-d0745bfaebec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ec:8e', 'vm-uuid': '3e0a66b6-b8ef-4804-8197-39eaa11bed2b'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:18 user nova-compute[75255]: INFO os_vif [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82')
Nov 14 11:42:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:19 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-4b38e123-b6bc-4f8d-bc07-cc4a41a1f070 req-2f43685a-941e-47e7-9ac2-f328cfa8b5a3 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4b38e123-b6bc-4f8d-bc07-cc4a41a1f070 req-2f43685a-941e-47e7-9ac2-f328cfa8b5a3 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4b38e123-b6bc-4f8d-bc07-cc4a41a1f070 req-2f43685a-941e-47e7-9ac2-f328cfa8b5a3 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4b38e123-b6bc-4f8d-bc07-cc4a41a1f070 req-2f43685a-941e-47e7-9ac2-f328cfa8b5a3 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG nova.compute.manager [req-4b38e123-b6bc-4f8d-bc07-cc4a41a1f070 req-2f43685a-941e-47e7-9ac2-f328cfa8b5a3 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:42:20 user nova-compute[75255]: WARNING nova.compute.manager [req-4b38e123-b6bc-4f8d-bc07-cc4a41a1f070 req-2f43685a-941e-47e7-9ac2-f328cfa8b5a3 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state stopped and task_state powering-on.
Nov 14 11:42:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:42:22 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance rebooted successfully.
Nov 14 11:42:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-5ad3d521-74b5-44de-9ecb-590dbdb09a82 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:42:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-d8813ecc-d9b0-4d8e-b0c2-a0d0dc0a9b20 req-ef20692f-c46d-4b78-b920-97a6ed54c03d service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:42:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d8813ecc-d9b0-4d8e-b0c2-a0d0dc0a9b20 req-ef20692f-c46d-4b78-b920-97a6ed54c03d service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d8813ecc-d9b0-4d8e-b0c2-a0d0dc0a9b20 req-ef20692f-c46d-4b78-b920-97a6ed54c03d service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d8813ecc-d9b0-4d8e-b0c2-a0d0dc0a9b20 req-ef20692f-c46d-4b78-b920-97a6ed54c03d service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:22 user nova-compute[75255]: DEBUG nova.compute.manager [req-d8813ecc-d9b0-4d8e-b0c2-a0d0dc0a9b20 req-ef20692f-c46d-4b78-b920-97a6ed54c03d service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:42:22 user nova-compute[75255]: WARNING nova.compute.manager [req-d8813ecc-d9b0-4d8e-b0c2-a0d0dc0a9b20 req-ef20692f-c46d-4b78-b920-97a6ed54c03d service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state active and task_state None.
Nov 14 11:42:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:42:42 user nova-compute[75255]: INFO nova.compute.claims [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Claim successful on node user
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:42:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:42:42 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG nova.policy [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99569798a7b14c20ab22ed26a0b11fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae08eed848f44bda5da3485b0b6b374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:42:43 user nova-compute[75255]: INFO nova.virt.block_device [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Booting with volume 034a5277-fceb-4a3b-aa22-732b1ac9f99e at /dev/vda
Nov 14 11:42:43 user nova-compute[75255]: DEBUG os_brick.utils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a4d0c0-4308-4e0e-9a5b-629ef418c03b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a088f451-94be-440b-aa1f-1730c2e440c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[da66b5fc-bfa3-4101-9beb-e7e7d7b29583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[811b26b0-389d-4cfe-8391-e9026fe0fced]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:42:43 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:42:43 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92efc0e-bc33-4a0b-a26b-fe2951d28f58]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG os_brick.utils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Updating existing volume attachment record: 99ca577f-cc73-41c2-a1b2-8330172630b4 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Successfully created port: 7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:42:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Successfully updated port: 7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquired lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-changed-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.compute.manager [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Refreshing instance network info cache due to event network-changed-7a6d6eb9-4018-4f73-8959-db76782ecf83. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] Acquiring lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Updating instance_info_cache with network_info: [{"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Releasing lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Instance network_info: |[{"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] Acquired lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:42:44 user nova-compute[75255]: DEBUG nova.network.neutron [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Refreshing network info cache for port 7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:42:45 user nova-compute[75255]: DEBUG nova.network.neutron [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Updated VIF entry in instance network info cache for port 7a6d6eb9-4018-4f73-8959-db76782ecf83. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:42:45 user nova-compute[75255]: DEBUG nova.network.neutron [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Updating instance_info_cache with network_info: [{"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:42:45 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fd263e42-566c-4949-85c0-198d2313deaf req-8ddf8364-c36c-415b-8547-7fc016a1c5de service nova] Releasing lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:42:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:42:47 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Creating image(s)
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Ensure instance console log exists: /opt/stack/data/nova/instances/9fbac2b5-c834-4362-befa-7a14eccef92a/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Start _get_guest_xml network_info=[{"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '99ca577f-cc73-41c2-a1b2-8330172630b4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9fbac2b5-c834-4362-befa-7a14eccef92a', 'attached_at': '', 'detached_at': '', 'volume_id': '034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'serial': '034a5277-fceb-4a3b-aa22-732b1ac9f99e'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:42:47 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:42:47 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:42:47 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:42:47 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:42:47 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba62e76e-085b-45a8-9544-854c56bcaae9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:42:47 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b4a714-98e1-4e85-ac8a-d89653bd41bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e] added
Nov 14 11:42:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a3125-6738-4a10-ab78-eb7d2461ee42]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b819bcba-638b-4043-93ed-d81256495cdf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfDbSrpi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfDbSrpi" returned: 0 in 0.033s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8e6ab2-b20b-4d27-962b-5bcb17325104]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KfDbSrpi'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ae1387-946d-4073-92b4-98675a0bae02]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04c440e-73e3-4cb0-ae9e-ee3d6fce0140]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f412abae-8bf9-483f-965a-31d30d58161d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]
Nov 14 11:42:47 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.
Nov 14 11:42:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a813afe1-4a8a-406d-b676-6fac83f9dcc8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acea24f-8ca7-486b-bd07-d618566d7947]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:47 user nova-compute[75255]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:42:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:42:47 user nova-compute[75255]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:42:47 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[88634e35-0e15-4151-8d8c-793c31afff11]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:42:47 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23030333834613633', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333834613633', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744528399',display_name='tempest-TestVolumeBootPattern-server-744528399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744528399',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-9t7giyj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:42:43Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=9fbac2b5-c834-4362-befa-7a14eccef92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:92,bridge_name='br-int',has_traffic_filtering=True,id=7a6d6eb9-4018-4f73-8959-db76782ecf83,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d6eb9-40') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fbac2b5-c834-4362-befa-7a14eccef92a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:42:48 user nova-compute[75255]:   <uuid>9fbac2b5-c834-4362-befa-7a14eccef92a</uuid>
Nov 14 11:42:48 user nova-compute[75255]:   <name>instance-00000030</name>
Nov 14 11:42:48 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:42:48 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:42:48 user nova-compute[75255]:   <metadata>
Nov 14 11:42:48 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:42:48 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:42:48 user nova-compute[75255]:       <nova:name>tempest-TestVolumeBootPattern-server-744528399</nova:name>
Nov 14 11:42:48 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:42:47</nova:creationTime>
Nov 14 11:42:48 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:42:48 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:42:48 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:42:48 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:42:48 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:42:48 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:42:48 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:42:48 user nova-compute[75255]:       <nova:owner>
Nov 14 11:42:48 user nova-compute[75255]:         <nova:user uuid="99569798a7b14c20ab22ed26a0b11fd2">tempest-TestVolumeBootPattern-1575864965-project-member</nova:user>
Nov 14 11:42:48 user nova-compute[75255]:         <nova:project uuid="5ae08eed848f44bda5da3485b0b6b374">tempest-TestVolumeBootPattern-1575864965</nova:project>
Nov 14 11:42:48 user nova-compute[75255]:       </nova:owner>
Nov 14 11:42:48 user nova-compute[75255]:       <nova:ports>
Nov 14 11:42:48 user nova-compute[75255]:         <nova:port uuid="7a6d6eb9-4018-4f73-8959-db76782ecf83">
Nov 14 11:42:48 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 11:42:48 user nova-compute[75255]:         </nova:port>
Nov 14 11:42:48 user nova-compute[75255]:       </nova:ports>
Nov 14 11:42:48 user nova-compute[75255]:     </nova:instance>
Nov 14 11:42:48 user nova-compute[75255]:   </metadata>
Nov 14 11:42:48 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:42:48 user nova-compute[75255]:     <system>
Nov 14 11:42:48 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:42:48 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:42:48 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:42:48 user nova-compute[75255]:       <entry name="serial">9fbac2b5-c834-4362-befa-7a14eccef92a</entry>
Nov 14 11:42:48 user nova-compute[75255]:       <entry name="uuid">9fbac2b5-c834-4362-befa-7a14eccef92a</entry>
Nov 14 11:42:48 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:42:48 user nova-compute[75255]:     </system>
Nov 14 11:42:48 user nova-compute[75255]:   </sysinfo>
Nov 14 11:42:48 user nova-compute[75255]:   <os>
Nov 14 11:42:48 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:42:48 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:42:48 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:42:48 user nova-compute[75255]:   </os>
Nov 14 11:42:48 user nova-compute[75255]:   <features>
Nov 14 11:42:48 user nova-compute[75255]:     <acpi/>
Nov 14 11:42:48 user nova-compute[75255]:     <apic/>
Nov 14 11:42:48 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:42:48 user nova-compute[75255]:   </features>
Nov 14 11:42:48 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:42:48 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:42:48 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:42:48 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:42:48 user nova-compute[75255]:   </clock>
Nov 14 11:42:48 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:42:48 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:42:48 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:42:48 user nova-compute[75255]:   </cpu>
Nov 14 11:42:48 user nova-compute[75255]:   <devices>
Nov 14 11:42:48 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:42:48 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:42:48 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:42:48 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:42:48 user nova-compute[75255]:       <serial>034a5277-fceb-4a3b-aa22-732b1ac9f99e</serial>
Nov 14 11:42:48 user nova-compute[75255]:     </disk>
Nov 14 11:42:48 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:42:48 user nova-compute[75255]:       <mac address="fa:16:3e:ed:a6:92"/>
Nov 14 11:42:48 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:42:48 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:42:48 user nova-compute[75255]:       <target dev="tap7a6d6eb9-40"/>
Nov 14 11:42:48 user nova-compute[75255]:     </interface>
Nov 14 11:42:48 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:42:48 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/9fbac2b5-c834-4362-befa-7a14eccef92a/console.log" append="off"/>
Nov 14 11:42:48 user nova-compute[75255]:     </serial>
Nov 14 11:42:48 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:42:48 user nova-compute[75255]:     <video>
Nov 14 11:42:48 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:42:48 user nova-compute[75255]:     </video>
Nov 14 11:42:48 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:42:48 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:42:48 user nova-compute[75255]:     </rng>
Nov 14 11:42:48 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:42:48 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:42:48 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:42:48 user nova-compute[75255]:     </memballoon>
Nov 14 11:42:48 user nova-compute[75255]:   </devices>
Nov 14 11:42:48 user nova-compute[75255]: </domain>
Nov 14 11:42:48 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744528399',display_name='tempest-TestVolumeBootPattern-server-744528399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744528399',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-9t7giyj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:42:43Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=9fbac2b5-c834-4362-befa-7a14eccef92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:92,bridge_name='br-int',has_traffic_filtering=True,id=7a6d6eb9-4018-4f73-8959-db76782ecf83,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d6eb9-40') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG os_vif [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:92,bridge_name='br-int',has_traffic_filtering=True,id=7a6d6eb9-4018-4f73-8959-db76782ecf83,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d6eb9-40') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51ece68c-56ec-555a-aa2d-08349879f1bc', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a6d6eb9-40, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a6d6eb9-40, col_values=(('qos', UUID('397149fd-9830-451d-95a4-72a64c7ead0f')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a6d6eb9-40, col_values=(('external_ids', {'iface-id': '7a6d6eb9-4018-4f73-8959-db76782ecf83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a6:92', 'vm-uuid': '9fbac2b5-c834-4362-befa-7a14eccef92a'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:42:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:48 user nova-compute[75255]: INFO os_vif [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:92,bridge_name='br-int',has_traffic_filtering=True,id=7a6d6eb9-4018-4f73-8959-db76782ecf83,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d6eb9-40')
Nov 14 11:42:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:42:49 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No VIF found with MAC fa:16:3e:ed:a6:92, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-7117192b-1df6-4586-a1c5-e0dc09122772 req-553e7eea-5342-4279-9ab9-143ad1257873 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7117192b-1df6-4586-a1c5-e0dc09122772 req-553e7eea-5342-4279-9ab9-143ad1257873 service nova] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7117192b-1df6-4586-a1c5-e0dc09122772 req-553e7eea-5342-4279-9ab9-143ad1257873 service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7117192b-1df6-4586-a1c5-e0dc09122772 req-553e7eea-5342-4279-9ab9-143ad1257873 service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG nova.compute.manager [req-7117192b-1df6-4586-a1c5-e0dc09122772 req-553e7eea-5342-4279-9ab9-143ad1257873 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] No waiting events found dispatching network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:42:50 user nova-compute[75255]: WARNING nova.compute.manager [req-7117192b-1df6-4586-a1c5-e0dc09122772 req-553e7eea-5342-4279-9ab9-143ad1257873 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received unexpected event network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 for instance with vm_state building and task_state spawning.
Nov 14 11:42:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:42:52 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Instance spawned successfully.
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:42:52 user nova-compute[75255]: INFO nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.compute.manager [req-943fe08d-662f-4059-85bc-c938d7831737 req-c36bd67f-a0d3-4a01-a12a-6f8cd867c397 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-943fe08d-662f-4059-85bc-c938d7831737 req-c36bd67f-a0d3-4a01-a12a-6f8cd867c397 service nova] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-943fe08d-662f-4059-85bc-c938d7831737 req-c36bd67f-a0d3-4a01-a12a-6f8cd867c397 service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-943fe08d-662f-4059-85bc-c938d7831737 req-c36bd67f-a0d3-4a01-a12a-6f8cd867c397 service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:52 user nova-compute[75255]: DEBUG nova.compute.manager [req-943fe08d-662f-4059-85bc-c938d7831737 req-c36bd67f-a0d3-4a01-a12a-6f8cd867c397 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] No waiting events found dispatching network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:42:52 user nova-compute[75255]: WARNING nova.compute.manager [req-943fe08d-662f-4059-85bc-c938d7831737 req-c36bd67f-a0d3-4a01-a12a-6f8cd867c397 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received unexpected event network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 for instance with vm_state building and task_state spawning.
Nov 14 11:42:52 user nova-compute[75255]: INFO nova.compute.manager [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Took 9.97 seconds to build instance.
Nov 14 11:42:52 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d9111899-5e52-4617-9b1e-d294b3683c07 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.102s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:42:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:42:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:42:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:43:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:43:00 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:43:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.035541534423828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9fbac2b5-c834-4362-befa-7a14eccef92a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:43:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:05 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:43:06 user nova-compute[75255]: INFO nova.compute.claims [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Claim successful on node user
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:43:06 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:43:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:43:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.policy [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11cb648ac3164cb1814062b544b747c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604a8502a46a4863a4ed1ba511a1afc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:43:07 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Creating image(s)
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "/opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "/opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Successfully created port: d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk 1073741824" returned: 0 in 0.060s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Cannot resize image /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Ensure instance console log exists: /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Successfully updated port: d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "refresh_cache-e2f52a38-7c50-43af-9d44-f4b4278e1f4b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquired lock "refresh_cache-e2f52a38-7c50-43af-9d44-f4b4278e1f4b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received event network-changed-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.compute.manager [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Refreshing instance network info cache due to event network-changed-d006afb6-0168-4340-b934-ab34635cf0dd. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] Acquiring lock "refresh_cache-e2f52a38-7c50-43af-9d44-f4b4278e1f4b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.neutron [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Updating instance_info_cache with network_info: [{"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Releasing lock "refresh_cache-e2f52a38-7c50-43af-9d44-f4b4278e1f4b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Instance network_info: |[{"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] Acquired lock "refresh_cache-e2f52a38-7c50-43af-9d44-f4b4278e1f4b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Refreshing network info cache for port d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Start _get_guest_xml network_info=[{"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:43:08 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:43:08 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-430217120',display_name='tempest-VolumesActionsTest-instance-430217120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-430217120',id=49,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='604a8502a46a4863a4ed1ba511a1afc8',ramdisk_id='',reservation_id='r-wd3stucl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1511734928',owner_user_name='tempest-VolumesActionsTest-1511734928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:43:07Z,user_data=None,user_id='11cb648ac3164cb1814062b544b747c7',uuid=e2f52a38-7c50-43af-9d44-f4b4278e1f4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Converting VIF {"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:97:59,bridge_name='br-int',has_traffic_filtering=True,id=d006afb6-0168-4340-b934-ab34635cf0dd,network=Network(f9bb0f1b-b278-4ae6-a65e-a6beed901346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd006afb6-01') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lazy-loading 'pci_devices' on Instance uuid e2f52a38-7c50-43af-9d44-f4b4278e1f4b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:43:08 user nova-compute[75255]:   <uuid>e2f52a38-7c50-43af-9d44-f4b4278e1f4b</uuid>
Nov 14 11:43:08 user nova-compute[75255]:   <name>instance-00000031</name>
Nov 14 11:43:08 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:43:08 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:43:08 user nova-compute[75255]:   <metadata>
Nov 14 11:43:08 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:43:08 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:43:08 user nova-compute[75255]:       <nova:name>tempest-VolumesActionsTest-instance-430217120</nova:name>
Nov 14 11:43:08 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:43:08</nova:creationTime>
Nov 14 11:43:08 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:43:08 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:43:08 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:43:08 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:43:08 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:43:08 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:43:08 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:43:08 user nova-compute[75255]:       <nova:owner>
Nov 14 11:43:08 user nova-compute[75255]:         <nova:user uuid="11cb648ac3164cb1814062b544b747c7">tempest-VolumesActionsTest-1511734928-project-member</nova:user>
Nov 14 11:43:08 user nova-compute[75255]:         <nova:project uuid="604a8502a46a4863a4ed1ba511a1afc8">tempest-VolumesActionsTest-1511734928</nova:project>
Nov 14 11:43:08 user nova-compute[75255]:       </nova:owner>
Nov 14 11:43:08 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:43:08 user nova-compute[75255]:       <nova:ports>
Nov 14 11:43:08 user nova-compute[75255]:         <nova:port uuid="d006afb6-0168-4340-b934-ab34635cf0dd">
Nov 14 11:43:08 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 11:43:08 user nova-compute[75255]:         </nova:port>
Nov 14 11:43:08 user nova-compute[75255]:       </nova:ports>
Nov 14 11:43:08 user nova-compute[75255]:     </nova:instance>
Nov 14 11:43:08 user nova-compute[75255]:   </metadata>
Nov 14 11:43:08 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:43:08 user nova-compute[75255]:     <system>
Nov 14 11:43:08 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:43:08 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:43:08 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:43:08 user nova-compute[75255]:       <entry name="serial">e2f52a38-7c50-43af-9d44-f4b4278e1f4b</entry>
Nov 14 11:43:08 user nova-compute[75255]:       <entry name="uuid">e2f52a38-7c50-43af-9d44-f4b4278e1f4b</entry>
Nov 14 11:43:08 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:43:08 user nova-compute[75255]:     </system>
Nov 14 11:43:08 user nova-compute[75255]:   </sysinfo>
Nov 14 11:43:08 user nova-compute[75255]:   <os>
Nov 14 11:43:08 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:43:08 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:43:08 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:43:08 user nova-compute[75255]:   </os>
Nov 14 11:43:08 user nova-compute[75255]:   <features>
Nov 14 11:43:08 user nova-compute[75255]:     <acpi/>
Nov 14 11:43:08 user nova-compute[75255]:     <apic/>
Nov 14 11:43:08 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:43:08 user nova-compute[75255]:   </features>
Nov 14 11:43:08 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:43:08 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:43:08 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:43:08 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:43:08 user nova-compute[75255]:   </clock>
Nov 14 11:43:08 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:43:08 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:43:08 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:43:08 user nova-compute[75255]:   </cpu>
Nov 14 11:43:08 user nova-compute[75255]:   <devices>
Nov 14 11:43:08 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:43:08 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:43:08 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk"/>
Nov 14 11:43:08 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:43:08 user nova-compute[75255]:     </disk>
Nov 14 11:43:08 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:43:08 user nova-compute[75255]:       <mac address="fa:16:3e:44:97:59"/>
Nov 14 11:43:08 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:43:08 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:43:08 user nova-compute[75255]:       <target dev="tapd006afb6-01"/>
Nov 14 11:43:08 user nova-compute[75255]:     </interface>
Nov 14 11:43:08 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:43:08 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/console.log" append="off"/>
Nov 14 11:43:08 user nova-compute[75255]:     </serial>
Nov 14 11:43:08 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:43:08 user nova-compute[75255]:     <video>
Nov 14 11:43:08 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:43:08 user nova-compute[75255]:     </video>
Nov 14 11:43:08 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:43:08 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:43:08 user nova-compute[75255]:     </rng>
Nov 14 11:43:08 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:43:08 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:43:08 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:43:08 user nova-compute[75255]:     </memballoon>
Nov 14 11:43:08 user nova-compute[75255]:   </devices>
Nov 14 11:43:08 user nova-compute[75255]: </domain>
Nov 14 11:43:08 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-430217120',display_name='tempest-VolumesActionsTest-instance-430217120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-430217120',id=49,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='604a8502a46a4863a4ed1ba511a1afc8',ramdisk_id='',reservation_id='r-wd3stucl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1511734928',owner_user_name='tempest-VolumesActionsTest-1511734928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:43:07Z,user_data=None,user_id='11cb648ac3164cb1814062b544b747c7',uuid=e2f52a38-7c50-43af-9d44-f4b4278e1f4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Converting VIF {"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:97:59,bridge_name='br-int',has_traffic_filtering=True,id=d006afb6-0168-4340-b934-ab34635cf0dd,network=Network(f9bb0f1b-b278-4ae6-a65e-a6beed901346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd006afb6-01') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG os_vif [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:97:59,bridge_name='br-int',has_traffic_filtering=True,id=d006afb6-0168-4340-b934-ab34635cf0dd,network=Network(f9bb0f1b-b278-4ae6-a65e-a6beed901346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd006afb6-01') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5281252-589b-5d01-a47d-da5ae7065b42', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd006afb6-01, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd006afb6-01, col_values=(('qos', UUID('7a989f0d-a78d-4809-8201-91830629ee7a')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd006afb6-01, col_values=(('external_ids', {'iface-id': 'd006afb6-0168-4340-b934-ab34635cf0dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:97:59', 'vm-uuid': 'e2f52a38-7c50-43af-9d44-f4b4278e1f4b'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:08 user nova-compute[75255]: INFO os_vif [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:97:59,bridge_name='br-int',has_traffic_filtering=True,id=d006afb6-0168-4340-b934-ab34635cf0dd,network=Network(f9bb0f1b-b278-4ae6-a65e-a6beed901346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd006afb6-01')
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] No VIF found with MAC fa:16:3e:44:97:59, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Updated VIF entry in instance network info cache for port d006afb6-0168-4340-b934-ab34635cf0dd. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG nova.network.neutron [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Updating instance_info_cache with network_info: [{"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:43:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7926d58b-a4d0-4e04-b86d-993724b241e3 req-8f76531c-0846-4c6a-84a8-3966b9288279 service nova] Releasing lock "refresh_cache-e2f52a38-7c50-43af-9d44-f4b4278e1f4b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-1b2f81de-ae6b-4bb0-9597-b3add78f6aff req-ef026832-d41a-4a9d-9332-8372897e61a5 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received event network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1b2f81de-ae6b-4bb0-9597-b3add78f6aff req-ef026832-d41a-4a9d-9332-8372897e61a5 service nova] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1b2f81de-ae6b-4bb0-9597-b3add78f6aff req-ef026832-d41a-4a9d-9332-8372897e61a5 service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1b2f81de-ae6b-4bb0-9597-b3add78f6aff req-ef026832-d41a-4a9d-9332-8372897e61a5 service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-1b2f81de-ae6b-4bb0-9597-b3add78f6aff req-ef026832-d41a-4a9d-9332-8372897e61a5 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] No waiting events found dispatching network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:43:09 user nova-compute[75255]: WARNING nova.compute.manager [req-1b2f81de-ae6b-4bb0-9597-b3add78f6aff req-ef026832-d41a-4a9d-9332-8372897e61a5 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received unexpected event network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd for instance with vm_state building and task_state spawning.
Nov 14 11:43:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_power_states {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid 9fbac2b5-c834-4362-befa-7a14eccef92a {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Triggering sync for uuid e2f52a38-7c50-43af-9d44-f4b4278e1f4b {{(pid=75255) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-0b3c686e-0ead-4b72-9eb1-72abfe883491 req-8238c4c5-9347-4c09-a8c4-26e75a830a01 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received event network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0b3c686e-0ead-4b72-9eb1-72abfe883491 req-8238c4c5-9347-4c09-a8c4-26e75a830a01 service nova] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0b3c686e-0ead-4b72-9eb1-72abfe883491 req-8238c4c5-9347-4c09-a8c4-26e75a830a01 service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0b3c686e-0ead-4b72-9eb1-72abfe883491 req-8238c4c5-9347-4c09-a8c4-26e75a830a01 service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-0b3c686e-0ead-4b72-9eb1-72abfe883491 req-8238c4c5-9347-4c09-a8c4-26e75a830a01 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] No waiting events found dispatching network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:43:12 user nova-compute[75255]: WARNING nova.compute.manager [req-0b3c686e-0ead-4b72-9eb1-72abfe883491 req-8238c4c5-9347-4c09-a8c4-26e75a830a01 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received unexpected event network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd for instance with vm_state building and task_state spawning.
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:43:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Instance spawned successfully.
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:43:12 user nova-compute[75255]: INFO nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 11:43:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:43:12 user nova-compute[75255]: INFO nova.compute.manager [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Took 5.77 seconds to build instance.
Nov 14 11:43:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e3efb6fd-a758-43bb-aa99-1deedb5b8125 tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.865s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.790s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:43:12 user nova-compute[75255]: INFO nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 14 11:43:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:43:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:43:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:43:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:43:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:43:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:43:49 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:43:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:43:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:43:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:00 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:44:01 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:44:01 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=25.005699157714844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 9fbac2b5-c834-4362-befa-7a14eccef92a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance e2f52a38-7c50-43af-9d44-f4b4278e1f4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:44:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:02 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:44:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:05 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:06 user nova-compute[75255]: INFO nova.compute.manager [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Detaching volume f80e2dde-7377-4198-853e-c5da8bac8ed1
Nov 14 11:44:07 user nova-compute[75255]: INFO nova.virt.block_device [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Attempting to driver detach volume f80e2dde-7377-4198-853e-c5da8bac8ed1 from mountpoint /dev/vdb
Nov 14 11:44:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Attempting to detach device vdb from instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:44:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:44:07 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:44:07 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:44:07 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:44:07 user nova-compute[75255]:   <serial>f80e2dde-7377-4198-853e-c5da8bac8ed1</serial>
Nov 14 11:44:07 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:44:07 user nova-compute[75255]: </disk>
Nov 14 11:44:07 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:44:07 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully detached device vdb from instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b from the persistent domain config.
Nov 14 11:44:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:44:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:44:07 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:44:07 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:44:07 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:44:07 user nova-compute[75255]:   <serial>f80e2dde-7377-4198-853e-c5da8bac8ed1</serial>
Nov 14 11:44:07 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 11:44:07 user nova-compute[75255]: </disk>
Nov 14 11:44:07 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:44:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:44:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:44:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:44:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:44:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:44:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:44:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:44:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:27 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b is timed out.
Nov 14 11:44:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully detached device vdb from instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b from the live domain config.
Nov 14 11:44:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANtdChTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:44:27 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7e4e8f-6a19-4e52-bff4-7325d01476a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:44:27 user nova-compute[75255]: No targets found.
Nov 14 11:44:27 user nova-compute[75255]: iSNS:
Nov 14 11:44:27 user nova-compute[75255]: No targets found.
Nov 14 11:44:27 user nova-compute[75255]: STATIC:
Nov 14 11:44:27 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e
Nov 14 11:44:27 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:44:27 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:44:27 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1
Nov 14 11:44:27 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:44:27 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:44:27 user nova-compute[75255]: FIRMWARE:
Nov 14 11:44:27 user nova-compute[75255]: No targets found.
Nov 14 11:44:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:44:27 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:44:27 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6e3079-df2f-4d0e-baf8-2787ffdce73c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1148fbc2-a640-4ee0-a038-60eaa8f4ac73]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:44:27 user nova-compute[75255]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:44:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 (non-flash)
Nov 14 11:44:27 user nova-compute[75255]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:44:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff308759000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56741d-1fa4-4f10-829b-2c86deae4bf0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2b4bf-c241-4a35-97ba-dcb2ae594515]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5343f192-2156-4731-898a-6f8ca1762743]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafd4b1d-470f-4696-85ad-ed9f20dda8e9]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4913ae-7488-4547-a31c-9207ca6a57bf]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d7714a-08e4-40c6-9a5b-2ca9f6116763]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260]
Nov 14 11:44:27 user nova-compute[75255]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1, portal: 172.16.0.220,3260] successful.
Nov 14 11:44:27 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80e2dde-7377-4198-853e-c5da8bac8ed1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3211f5-3bfe-4f46-8617-bdcb21ecaed9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== disconnect_volume: return (309ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:44:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:44:28 user nova-compute[75255]: DEBUG nova.objects.instance [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:44:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45b1e066-c8c4-4abd-bc36-02e48d940112 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d1fcf11d-4429-4b62-a39f-5b6a32a8db71 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d1fcf11d-4429-4b62-a39f-5b6a32a8db71 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d1fcf11d-4429-4b62-a39f-5b6a32a8db71 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d1fcf11d-4429-4b62-a39f-5b6a32a8db71 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75255) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d1fcf11d-4429-4b62-a39f-5b6a32a8db71 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-3e606811-a3b5-4ff7-9d94-760397bd3dc3 req-09ed7092-0b76-47f1-9982-769b668a9bc5 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3e606811-a3b5-4ff7-9d94-760397bd3dc3 req-09ed7092-0b76-47f1-9982-769b668a9bc5 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3e606811-a3b5-4ff7-9d94-760397bd3dc3 req-09ed7092-0b76-47f1-9982-769b668a9bc5 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3e606811-a3b5-4ff7-9d94-760397bd3dc3 req-09ed7092-0b76-47f1-9982-769b668a9bc5 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:29 user nova-compute[75255]: DEBUG nova.compute.manager [req-3e606811-a3b5-4ff7-9d94-760397bd3dc3 req-09ed7092-0b76-47f1-9982-769b668a9bc5 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:44:29 user nova-compute[75255]: WARNING nova.compute.manager [req-3e606811-a3b5-4ff7-9d94-760397bd3dc3 req-09ed7092-0b76-47f1-9982-769b668a9bc5 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state active and task_state powering-off.
Nov 14 11:44:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:30 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance destroyed successfully.
Nov 14 11:44:30 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d1fcf11d-4429-4b62-a39f-5b6a32a8db71 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:44:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d1fcf11d-4429-4b62-a39f-5b6a32a8db71 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.834s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-97dd69eb-5481-4b31-8f52-6f96a2ea1275 req-74098a1b-7a62-4d08-bc12-d479455f96c1 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:44:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-97dd69eb-5481-4b31-8f52-6f96a2ea1275 req-74098a1b-7a62-4d08-bc12-d479455f96c1 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-97dd69eb-5481-4b31-8f52-6f96a2ea1275 req-74098a1b-7a62-4d08-bc12-d479455f96c1 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-97dd69eb-5481-4b31-8f52-6f96a2ea1275 req-74098a1b-7a62-4d08-bc12-d479455f96c1 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:31 user nova-compute[75255]: DEBUG nova.compute.manager [req-97dd69eb-5481-4b31-8f52-6f96a2ea1275 req-74098a1b-7a62-4d08-bc12-d479455f96c1 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:44:31 user nova-compute[75255]: WARNING nova.compute.manager [req-97dd69eb-5481-4b31-8f52-6f96a2ea1275 req-74098a1b-7a62-4d08-bc12-d479455f96c1 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state stopped and task_state None.
Nov 14 11:44:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-changed-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Refreshing instance network info cache due to event network-changed-7a6d6eb9-4018-4f73-8959-db76782ecf83. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] Acquiring lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] Acquired lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Refreshing network info cache for port 7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Updated VIF entry in instance network info cache for port 7a6d6eb9-4018-4f73-8959-db76782ecf83. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG nova.network.neutron [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Updating instance_info_cache with network_info: [{"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-00be8cb3-1e58-4efc-bebf-f70a8f74ba22 req-a6c1251b-57f7-4eee-ac28-5f084fee2d47 service nova] Releasing lock "refresh_cache-9fbac2b5-c834-4362-befa-7a14eccef92a" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:34 user nova-compute[75255]: INFO nova.compute.manager [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Terminating instance
Nov 14 11:44:34 user nova-compute[75255]: DEBUG nova.compute.manager [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-e208b388-3496-432a-a767-dc88c66802b2 req-0a23599a-f9ec-4fc8-952e-e75421bdefdf service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-vif-unplugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e208b388-3496-432a-a767-dc88c66802b2 req-0a23599a-f9ec-4fc8-952e-e75421bdefdf service nova] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e208b388-3496-432a-a767-dc88c66802b2 req-0a23599a-f9ec-4fc8-952e-e75421bdefdf service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-e208b388-3496-432a-a767-dc88c66802b2 req-0a23599a-f9ec-4fc8-952e-e75421bdefdf service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-e208b388-3496-432a-a767-dc88c66802b2 req-0a23599a-f9ec-4fc8-952e-e75421bdefdf service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] No waiting events found dispatching network-vif-unplugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.compute.manager [req-e208b388-3496-432a-a767-dc88c66802b2 req-0a23599a-f9ec-4fc8-952e-e75421bdefdf service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-vif-unplugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Instance destroyed successfully.
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'resources' on Instance uuid 9fbac2b5-c834-4362-befa-7a14eccef92a {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744528399',display_name='tempest-TestVolumeBootPattern-server-744528399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744528399',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:42:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-9t7giyj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:42:53Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=9fbac2b5-c834-4362-befa-7a14eccef92a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "address": "fa:16:3e:ed:a6:92", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6d6eb9-40", "ovs_interfaceid": "7a6d6eb9-4018-4f73-8959-db76782ecf83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:92,bridge_name='br-int',has_traffic_filtering=True,id=7a6d6eb9-4018-4f73-8959-db76782ecf83,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d6eb9-40') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_vif [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:92,bridge_name='br-int',has_traffic_filtering=True,id=7a6d6eb9-4018-4f73-8959-db76782ecf83,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d6eb9-40') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a6d6eb9-40, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=397149fd-9830-451d-95a4-72a64c7ead0f) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:35 user nova-compute[75255]: INFO os_vif [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:92,bridge_name='br-int',has_traffic_filtering=True,id=7a6d6eb9-4018-4f73-8959-db76782ecf83,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6d6eb9-40')
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:44:35 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8e7d38-1dce-4706-9547-a031e5e07c37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:44:35 user nova-compute[75255]: No targets found.
Nov 14 11:44:35 user nova-compute[75255]: iSNS:
Nov 14 11:44:35 user nova-compute[75255]: No targets found.
Nov 14 11:44:35 user nova-compute[75255]: STATIC:
Nov 14 11:44:35 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e
Nov 14 11:44:35 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:44:35 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:44:35 user nova-compute[75255]: FIRMWARE:
Nov 14 11:44:35 user nova-compute[75255]: No targets found.
Nov 14 11:44:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:44:35 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:44:35 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[25561802-eae8-4f3c-b4dd-97a7d0295cbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ad0da-656b-4060-9c0f-a5ad4f2d49ad]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:44:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:44:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086be170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec0adb-4d02-4211-bcdc-61348ce35d52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ba02b-ca71-4956-9728-2a02323f97a6]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[098a601d-72b1-4895-9ce9-690468dfb9c2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b831d91a-b62f-45a5-964d-26d706a3e1db]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23030333834613633', '/dev/disk/by-id/scsi-1SCST_BIOc90139d2-00384a63a4f2450e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c90139d2') {{(pid=86497) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166f64c-ef09-42d7-85ca-4a27a5690be2]: (4, None) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e30f4b-e3a4-4918-9ff9-59d4062f1e54]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf5b5cc-e396-4b58-a358-48bbe19ef6de]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]
Nov 14 11:44:35 user nova-compute[75255]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.
Nov 14 11:44:35 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6c8df-7d34-48fb-b6f4-858060f3ec15]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== disconnect_volume: return (294ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:44:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Deleting instance files /opt/stack/data/nova/instances/9fbac2b5-c834-4362-befa-7a14eccef92a_del
Nov 14 11:44:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Deletion of /opt/stack/data/nova/instances/9fbac2b5-c834-4362-befa-7a14eccef92a_del complete
Nov 14 11:44:35 user nova-compute[75255]: INFO nova.compute.manager [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 11:44:35 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:44:35 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:44:36 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:44:36 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Took 0.60 seconds to deallocate network for instance.
Nov 14 11:44:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-beefd973-fdaf-48b3-ad98-517fcc06110c req-454f1efd-c4e3-4bab-a66d-d2c1a5bf3f7f service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-beefd973-fdaf-48b3-ad98-517fcc06110c req-454f1efd-c4e3-4bab-a66d-d2c1a5bf3f7f service nova] Acquiring lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-beefd973-fdaf-48b3-ad98-517fcc06110c req-454f1efd-c4e3-4bab-a66d-d2c1a5bf3f7f service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-beefd973-fdaf-48b3-ad98-517fcc06110c req-454f1efd-c4e3-4bab-a66d-d2c1a5bf3f7f service nova] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-beefd973-fdaf-48b3-ad98-517fcc06110c req-454f1efd-c4e3-4bab-a66d-d2c1a5bf3f7f service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] No waiting events found dispatching network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:44:37 user nova-compute[75255]: WARNING nova.compute.manager [req-beefd973-fdaf-48b3-ad98-517fcc06110c req-454f1efd-c4e3-4bab-a66d-d2c1a5bf3f7f service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received unexpected event network-vif-plugged-7a6d6eb9-4018-4f73-8959-db76782ecf83 for instance with vm_state active and task_state deleting.
Nov 14 11:44:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-beefd973-fdaf-48b3-ad98-517fcc06110c req-454f1efd-c4e3-4bab-a66d-d2c1a5bf3f7f service nova] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Received event network-vif-deleted-7a6d6eb9-4018-4f73-8959-db76782ecf83 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:44:37 user nova-compute[75255]: INFO nova.compute.manager [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 9fbac2b5-c834-4362-befa-7a14eccef92a] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 11:44:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:44:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:37 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Deleted allocations for instance 9fbac2b5-c834-4362-befa-7a14eccef92a
Nov 14 11:44:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-388c67cd-bd39-4c94-bf62-677d82a6b1de tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "9fbac2b5-c834-4362-befa-7a14eccef92a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.923s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:44:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:44:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:44:50 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:53 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:53 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:44:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:01 user nova-compute[75255]: INFO nova.compute.manager [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Terminating instance
Nov 14 11:45:01 user nova-compute[75255]: DEBUG nova.compute.manager [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a57844cd-5e6f-410f-9e2b-803cb74a91c4 req-0e51377e-20ba-4be3-8cc6-f357ed34ad5d service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received event network-vif-unplugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a57844cd-5e6f-410f-9e2b-803cb74a91c4 req-0e51377e-20ba-4be3-8cc6-f357ed34ad5d service nova] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a57844cd-5e6f-410f-9e2b-803cb74a91c4 req-0e51377e-20ba-4be3-8cc6-f357ed34ad5d service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a57844cd-5e6f-410f-9e2b-803cb74a91c4 req-0e51377e-20ba-4be3-8cc6-f357ed34ad5d service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a57844cd-5e6f-410f-9e2b-803cb74a91c4 req-0e51377e-20ba-4be3-8cc6-f357ed34ad5d service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] No waiting events found dispatching network-vif-unplugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:45:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-a57844cd-5e6f-410f-9e2b-803cb74a91c4 req-0e51377e-20ba-4be3-8cc6-f357ed34ad5d service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received event network-vif-unplugged-d006afb6-0168-4340-b934-ab34635cf0dd for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Instance destroyed successfully.
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.objects.instance [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lazy-loading 'resources' on Instance uuid e2f52a38-7c50-43af-9d44-f4b4278e1f4b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-430217120',display_name='tempest-VolumesActionsTest-instance-430217120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-430217120',id=49,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='604a8502a46a4863a4ed1ba511a1afc8',ramdisk_id='',reservation_id='r-wd3stucl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1511734928',owner_user_name='tempest-VolumesActionsTest-1511734928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:43:12Z,user_data=None,user_id='11cb648ac3164cb1814062b544b747c7',uuid=e2f52a38-7c50-43af-9d44-f4b4278e1f4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Converting VIF {"id": "d006afb6-0168-4340-b934-ab34635cf0dd", "address": "fa:16:3e:44:97:59", "network": {"id": "f9bb0f1b-b278-4ae6-a65e-a6beed901346", "bridge": "br-int", "label": "tempest-VolumesActionsTest-79417441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "604a8502a46a4863a4ed1ba511a1afc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd006afb6-01", "ovs_interfaceid": "d006afb6-0168-4340-b934-ab34635cf0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:97:59,bridge_name='br-int',has_traffic_filtering=True,id=d006afb6-0168-4340-b934-ab34635cf0dd,network=Network(f9bb0f1b-b278-4ae6-a65e-a6beed901346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd006afb6-01') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG os_vif [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:97:59,bridge_name='br-int',has_traffic_filtering=True,id=d006afb6-0168-4340-b934-ab34635cf0dd,network=Network(f9bb0f1b-b278-4ae6-a65e-a6beed901346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd006afb6-01') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd006afb6-01, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a989f0d-a78d-4809-8201-91830629ee7a) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:02 user nova-compute[75255]: INFO os_vif [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:97:59,bridge_name='br-int',has_traffic_filtering=True,id=d006afb6-0168-4340-b934-ab34635cf0dd,network=Network(f9bb0f1b-b278-4ae6-a65e-a6beed901346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd006afb6-01')
Nov 14 11:45:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Deleting instance files /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b_del
Nov 14 11:45:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Deletion of /opt/stack/data/nova/instances/e2f52a38-7c50-43af-9d44-f4b4278e1f4b_del complete
Nov 14 11:45:02 user nova-compute[75255]: INFO nova.compute.manager [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:45:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Error from libvirt while getting description of instance-00000031: [Error Code 42] Domain not found: no domain with matching uuid 'e2f52a38-7c50-43af-9d44-f4b4278e1f4b' (instance-00000031): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e2f52a38-7c50-43af-9d44-f4b4278e1f4b' (instance-00000031)
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-a683c496-1e95-4939-a8ab-de86f606563c req-3d5f9b06-0cd5-4507-aa7e-ae9d37108b35 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received event network-vif-deleted-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:45:02 user nova-compute[75255]: INFO nova.compute.manager [req-a683c496-1e95-4939-a8ab-de86f606563c req-3d5f9b06-0cd5-4507-aa7e-ae9d37108b35 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Neutron deleted interface d006afb6-0168-4340-b934-ab34635cf0dd; detaching it from the instance and deleting it from the info cache
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.network.neutron [req-a683c496-1e95-4939-a8ab-de86f606563c req-3d5f9b06-0cd5-4507-aa7e-ae9d37108b35 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:45:02 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Took 0.38 seconds to deallocate network for instance.
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-a683c496-1e95-4939-a8ab-de86f606563c req-3d5f9b06-0cd5-4507-aa7e-ae9d37108b35 service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Detach interface failed, port_id=d006afb6-0168-4340-b934-ab34635cf0dd, reason: Instance e2f52a38-7c50-43af-9d44-f4b4278e1f4b could not be found. {{(pid=75255) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 11:45:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:45:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9079MB free_disk=25.004215240478516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.125s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:02 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Deleted allocations for instance e2f52a38-7c50-43af-9d44-f4b4278e1f4b
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-b6252697-9dd7-4470-af8f-f0ec4bea49fb tempest-VolumesActionsTest-1511734928 tempest-VolumesActionsTest-1511734928-project-member] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.757s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-2f681d7b-c5c7-4e8d-9763-b7b61a01fcd8 req-cc8fa98d-0807-4ba4-8a0e-3a95e8059a0a service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received event network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2f681d7b-c5c7-4e8d-9763-b7b61a01fcd8 req-cc8fa98d-0807-4ba4-8a0e-3a95e8059a0a service nova] Acquiring lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2f681d7b-c5c7-4e8d-9763-b7b61a01fcd8 req-cc8fa98d-0807-4ba4-8a0e-3a95e8059a0a service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2f681d7b-c5c7-4e8d-9763-b7b61a01fcd8 req-cc8fa98d-0807-4ba4-8a0e-3a95e8059a0a service nova] Lock "e2f52a38-7c50-43af-9d44-f4b4278e1f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-2f681d7b-c5c7-4e8d-9763-b7b61a01fcd8 req-cc8fa98d-0807-4ba4-8a0e-3a95e8059a0a service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] No waiting events found dispatching network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:45:03 user nova-compute[75255]: WARNING nova.compute.manager [req-2f681d7b-c5c7-4e8d-9763-b7b61a01fcd8 req-cc8fa98d-0807-4ba4-8a0e-3a95e8059a0a service nova] [instance: e2f52a38-7c50-43af-9d44-f4b4278e1f4b] Received unexpected event network-vif-plugged-d006afb6-0168-4340-b934-ab34635cf0dd for instance with vm_state deleted and task_state None.
Nov 14 11:45:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:07 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:45:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:45:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:45:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:45:26 user nova-compute[75255]: INFO nova.compute.claims [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Claim successful on node user
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.network.neutron [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:45:26 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG nova.policy [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99569798a7b14c20ab22ed26a0b11fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae08eed848f44bda5da3485b0b6b374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:45:26 user nova-compute[75255]: INFO nova.virt.block_device [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Booting with volume 034a5277-fceb-4a3b-aa22-732b1ac9f99e at /dev/vda
Nov 14 11:45:26 user nova-compute[75255]: DEBUG os_brick.utils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0012df64-1eda-4972-911a-67a2df69373f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:26 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57142a7-0aba-427d-a5ea-0f466c2d4f1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea00978b-a157-497f-876a-297122883e93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb15a9a6-4715-4f8c-937e-fa855a7d87b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:45:27 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:45:27 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecc317c-9e51-485d-95d6-dca7122b9a98]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG os_brick.utils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating existing volume attachment record: b1197e7a-5709-4cd3-b3d4-2959bd774882 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:45:27 user nova-compute[75255]: DEBUG nova.network.neutron [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Successfully created port: a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.network.neutron [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Successfully updated port: a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquired lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.network.neutron [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-changed-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.compute.manager [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Refreshing instance network info cache due to event network-changed-a05c1b03-6fa0-46f8-860e-02cb0453f59a. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] Acquiring lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.network.neutron [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.network.neutron [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating instance_info_cache with network_info: [{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Releasing lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Instance network_info: |[{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] Acquired lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Refreshing network info cache for port a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updated VIF entry in instance network info cache for port a05c1b03-6fa0-46f8-860e-02cb0453f59a. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG nova.network.neutron [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating instance_info_cache with network_info: [{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:45:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1505e1ad-aacf-427d-85fa-47e3c6f1ee89 req-7c6135b4-45b6-46fc-92e0-7e01f50e1942 service nova] Releasing lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:45:31 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Creating image(s)
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Ensure instance console log exists: /opt/stack/data/nova/instances/c15058da-9f64-4d23-b62b-f9fdef00c4b2/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Start _get_guest_xml network_info=[{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'b1197e7a-5709-4cd3-b3d4-2959bd774882', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c15058da-9f64-4d23-b62b-f9fdef00c4b2', 'attached_at': '', 'detached_at': '', 'volume_id': '034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'serial': '034a5277-fceb-4a3b-aa22-732b1ac9f99e'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:45:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:45:31 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:45:31 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:45:31 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:45:31 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383c68e-f44f-4173-83ab-4129fad7d69d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:45:31 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bdb675-da52-43cb-98eb-32c165dd96eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e] added
Nov 14 11:45:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f700140-055c-44dc-b5d9-dad8c3cc6e89]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf051bb6-1543-43ae-953d-d1bceec48a43]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfDbSrpi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfDbSrpi" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[504ff4ab-7c73-437d-b2a9-3b5df470ccee]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KfDbSrpi'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4bb181-49e5-4cd8-8d96-de2960d68585]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc37c3-9b7b-43d1-acc7-6599efce5a50]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:45:31 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:45:31 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:45:31 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:45:31 user nova-compute[75255]: 
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[50042cf8-59eb-487e-be4b-dec752420b4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]
Nov 14 11:45:31 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.
Nov 14 11:45:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a742734c-b6fe-462c-bc81-a6259d4e2b9c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe3553-68ee-41fa-8dbe-cd8ef6fc97d0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:45:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:45:31 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03457d7-f20c-414b-abfd-3dd3721952ec]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:45:31 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23030333834613633', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333834613633', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-294864733',display_name='tempest-TestVolumeBootPattern-server-294864733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-294864733',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-802480bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:45:27Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=c15058da-9f64-4d23-b62b-f9fdef00c4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:e8,bridge_name='br-int',has_traffic_filtering=True,id=a05c1b03-6fa0-46f8-860e-02cb0453f59a,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05c1b03-6f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.objects.instance [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'pci_devices' on Instance uuid c15058da-9f64-4d23-b62b-f9fdef00c4b2 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:45:32 user nova-compute[75255]:   <uuid>c15058da-9f64-4d23-b62b-f9fdef00c4b2</uuid>
Nov 14 11:45:32 user nova-compute[75255]:   <name>instance-00000032</name>
Nov 14 11:45:32 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:45:32 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:45:32 user nova-compute[75255]:   <metadata>
Nov 14 11:45:32 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:45:32 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:45:32 user nova-compute[75255]:       <nova:name>tempest-TestVolumeBootPattern-server-294864733</nova:name>
Nov 14 11:45:32 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:45:31</nova:creationTime>
Nov 14 11:45:32 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:45:32 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:45:32 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:45:32 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:45:32 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:45:32 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:45:32 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:45:32 user nova-compute[75255]:       <nova:owner>
Nov 14 11:45:32 user nova-compute[75255]:         <nova:user uuid="99569798a7b14c20ab22ed26a0b11fd2">tempest-TestVolumeBootPattern-1575864965-project-member</nova:user>
Nov 14 11:45:32 user nova-compute[75255]:         <nova:project uuid="5ae08eed848f44bda5da3485b0b6b374">tempest-TestVolumeBootPattern-1575864965</nova:project>
Nov 14 11:45:32 user nova-compute[75255]:       </nova:owner>
Nov 14 11:45:32 user nova-compute[75255]:       <nova:ports>
Nov 14 11:45:32 user nova-compute[75255]:         <nova:port uuid="a05c1b03-6fa0-46f8-860e-02cb0453f59a">
Nov 14 11:45:32 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 11:45:32 user nova-compute[75255]:         </nova:port>
Nov 14 11:45:32 user nova-compute[75255]:       </nova:ports>
Nov 14 11:45:32 user nova-compute[75255]:     </nova:instance>
Nov 14 11:45:32 user nova-compute[75255]:   </metadata>
Nov 14 11:45:32 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:45:32 user nova-compute[75255]:     <system>
Nov 14 11:45:32 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:45:32 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:45:32 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:45:32 user nova-compute[75255]:       <entry name="serial">c15058da-9f64-4d23-b62b-f9fdef00c4b2</entry>
Nov 14 11:45:32 user nova-compute[75255]:       <entry name="uuid">c15058da-9f64-4d23-b62b-f9fdef00c4b2</entry>
Nov 14 11:45:32 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:45:32 user nova-compute[75255]:     </system>
Nov 14 11:45:32 user nova-compute[75255]:   </sysinfo>
Nov 14 11:45:32 user nova-compute[75255]:   <os>
Nov 14 11:45:32 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:45:32 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:45:32 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:45:32 user nova-compute[75255]:   </os>
Nov 14 11:45:32 user nova-compute[75255]:   <features>
Nov 14 11:45:32 user nova-compute[75255]:     <acpi/>
Nov 14 11:45:32 user nova-compute[75255]:     <apic/>
Nov 14 11:45:32 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:45:32 user nova-compute[75255]:   </features>
Nov 14 11:45:32 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:45:32 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:45:32 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:45:32 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:45:32 user nova-compute[75255]:   </clock>
Nov 14 11:45:32 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:45:32 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:45:32 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:45:32 user nova-compute[75255]:   </cpu>
Nov 14 11:45:32 user nova-compute[75255]:   <devices>
Nov 14 11:45:32 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:45:32 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:45:32 user nova-compute[75255]:       <source dev="/dev/sdb"/>
Nov 14 11:45:32 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:45:32 user nova-compute[75255]:       <serial>034a5277-fceb-4a3b-aa22-732b1ac9f99e</serial>
Nov 14 11:45:32 user nova-compute[75255]:     </disk>
Nov 14 11:45:32 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:45:32 user nova-compute[75255]:       <mac address="fa:16:3e:d8:11:e8"/>
Nov 14 11:45:32 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:45:32 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:45:32 user nova-compute[75255]:       <target dev="tapa05c1b03-6f"/>
Nov 14 11:45:32 user nova-compute[75255]:     </interface>
Nov 14 11:45:32 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:45:32 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/c15058da-9f64-4d23-b62b-f9fdef00c4b2/console.log" append="off"/>
Nov 14 11:45:32 user nova-compute[75255]:     </serial>
Nov 14 11:45:32 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:45:32 user nova-compute[75255]:     <video>
Nov 14 11:45:32 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:45:32 user nova-compute[75255]:     </video>
Nov 14 11:45:32 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:45:32 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:45:32 user nova-compute[75255]:     </rng>
Nov 14 11:45:32 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:45:32 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:45:32 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:45:32 user nova-compute[75255]:     </memballoon>
Nov 14 11:45:32 user nova-compute[75255]:   </devices>
Nov 14 11:45:32 user nova-compute[75255]: </domain>
Nov 14 11:45:32 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-294864733',display_name='tempest-TestVolumeBootPattern-server-294864733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-294864733',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-802480bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:45:27Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=c15058da-9f64-4d23-b62b-f9fdef00c4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:e8,bridge_name='br-int',has_traffic_filtering=True,id=a05c1b03-6fa0-46f8-860e-02cb0453f59a,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05c1b03-6f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG os_vif [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:e8,bridge_name='br-int',has_traffic_filtering=True,id=a05c1b03-6fa0-46f8-860e-02cb0453f59a,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05c1b03-6f') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ae34fa4-690f-5d22-91d6-4f77d2c02e82', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa05c1b03-6f, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa05c1b03-6f, col_values=(('qos', UUID('e5afa39b-756c-450c-8880-6ca6bfebc9fd')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa05c1b03-6f, col_values=(('external_ids', {'iface-id': 'a05c1b03-6fa0-46f8-860e-02cb0453f59a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:11:e8', 'vm-uuid': 'c15058da-9f64-4d23-b62b-f9fdef00c4b2'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:32 user nova-compute[75255]: INFO os_vif [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:e8,bridge_name='br-int',has_traffic_filtering=True,id=a05c1b03-6fa0-46f8-860e-02cb0453f59a,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05c1b03-6f')
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:45:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No VIF found with MAC fa:16:3e:d8:11:e8, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:45:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-24c86319-5b60-431c-9afe-a8b8a19db03f req-e981f785-49f2-45ba-beec-c33781143930 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-24c86319-5b60-431c-9afe-a8b8a19db03f req-e981f785-49f2-45ba-beec-c33781143930 service nova] Acquiring lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-24c86319-5b60-431c-9afe-a8b8a19db03f req-e981f785-49f2-45ba-beec-c33781143930 service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-24c86319-5b60-431c-9afe-a8b8a19db03f req-e981f785-49f2-45ba-beec-c33781143930 service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG nova.compute.manager [req-24c86319-5b60-431c-9afe-a8b8a19db03f req-e981f785-49f2-45ba-beec-c33781143930 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] No waiting events found dispatching network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:45:34 user nova-compute[75255]: WARNING nova.compute.manager [req-24c86319-5b60-431c-9afe-a8b8a19db03f req-e981f785-49f2-45ba-beec-c33781143930 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received unexpected event network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a for instance with vm_state building and task_state spawning.
Nov 14 11:45:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:45:36 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Instance spawned successfully.
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:45:36 user nova-compute[75255]: INFO nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-3daec4d0-c97d-425b-b7c5-9f374ba838c4 req-1c716ed2-24b9-4303-be36-1724d33cdc27 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3daec4d0-c97d-425b-b7c5-9f374ba838c4 req-1c716ed2-24b9-4303-be36-1724d33cdc27 service nova] Acquiring lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3daec4d0-c97d-425b-b7c5-9f374ba838c4 req-1c716ed2-24b9-4303-be36-1724d33cdc27 service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-3daec4d0-c97d-425b-b7c5-9f374ba838c4 req-1c716ed2-24b9-4303-be36-1724d33cdc27 service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:36 user nova-compute[75255]: DEBUG nova.compute.manager [req-3daec4d0-c97d-425b-b7c5-9f374ba838c4 req-1c716ed2-24b9-4303-be36-1724d33cdc27 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] No waiting events found dispatching network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:45:36 user nova-compute[75255]: WARNING nova.compute.manager [req-3daec4d0-c97d-425b-b7c5-9f374ba838c4 req-1c716ed2-24b9-4303-be36-1724d33cdc27 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received unexpected event network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a for instance with vm_state building and task_state spawning.
Nov 14 11:45:36 user nova-compute[75255]: INFO nova.compute.manager [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Took 9.81 seconds to build instance.
Nov 14 11:45:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-69652841-1218-4a63-96ff-754da4357f15 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.910s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:45:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:45:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:45:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:45:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:45:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:51 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:54 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:55 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:45:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:45:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:46:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:46:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.022071838378906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c15058da-9f64-4d23-b62b-f9fdef00c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:46:02 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:46:03 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:46:03 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:46:03 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:46:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:46:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:04 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:46:05 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:08 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:46:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:46:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.network.neutron [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'info_cache' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.base [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.network.neutron [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:46:20 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance destroyed successfully.
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'resources' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.base [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG os_vif [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66e9baab-82, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bff9547-6cde-4d5c-b570-15f31cc4d31e) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:20 user nova-compute[75255]: INFO os_vif [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82')
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Start _get_guest_xml network_info=[{"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'numa_topology' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.base [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:46:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:46:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.base [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.objects.base [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:46:20 user nova-compute[75255]:   <uuid>3e0a66b6-b8ef-4804-8197-39eaa11bed2b</uuid>
Nov 14 11:46:20 user nova-compute[75255]:   <name>instance-0000002e</name>
Nov 14 11:46:20 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:46:20 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:46:20 user nova-compute[75255]:   <metadata>
Nov 14 11:46:20 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:46:20 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:46:20 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeTestJSON-server-1911577971</nova:name>
Nov 14 11:46:20 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:46:20</nova:creationTime>
Nov 14 11:46:20 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:46:20 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:46:20 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:46:20 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:46:20 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:46:20 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:46:20 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:46:20 user nova-compute[75255]:       <nova:owner>
Nov 14 11:46:20 user nova-compute[75255]:         <nova:user uuid="d508f30ed89a4451a0a383019d98dae4">tempest-AttachVolumeTestJSON-545907524-project-member</nova:user>
Nov 14 11:46:20 user nova-compute[75255]:         <nova:project uuid="f32711b26ee74011b2733543d7c60c81">tempest-AttachVolumeTestJSON-545907524</nova:project>
Nov 14 11:46:20 user nova-compute[75255]:       </nova:owner>
Nov 14 11:46:20 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:46:20 user nova-compute[75255]:       <nova:ports>
Nov 14 11:46:20 user nova-compute[75255]:         <nova:port uuid="66e9baab-8248-4e5e-aec3-d0745bfaebec">
Nov 14 11:46:20 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 11:46:20 user nova-compute[75255]:         </nova:port>
Nov 14 11:46:20 user nova-compute[75255]:       </nova:ports>
Nov 14 11:46:20 user nova-compute[75255]:     </nova:instance>
Nov 14 11:46:20 user nova-compute[75255]:   </metadata>
Nov 14 11:46:20 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:46:20 user nova-compute[75255]:     <system>
Nov 14 11:46:20 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:46:20 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:46:20 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:46:20 user nova-compute[75255]:       <entry name="serial">3e0a66b6-b8ef-4804-8197-39eaa11bed2b</entry>
Nov 14 11:46:20 user nova-compute[75255]:       <entry name="uuid">3e0a66b6-b8ef-4804-8197-39eaa11bed2b</entry>
Nov 14 11:46:20 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:46:20 user nova-compute[75255]:     </system>
Nov 14 11:46:20 user nova-compute[75255]:   </sysinfo>
Nov 14 11:46:20 user nova-compute[75255]:   <os>
Nov 14 11:46:20 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:46:20 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:46:20 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:46:20 user nova-compute[75255]:   </os>
Nov 14 11:46:20 user nova-compute[75255]:   <features>
Nov 14 11:46:20 user nova-compute[75255]:     <acpi/>
Nov 14 11:46:20 user nova-compute[75255]:     <apic/>
Nov 14 11:46:20 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:46:20 user nova-compute[75255]:   </features>
Nov 14 11:46:20 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:46:20 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:46:20 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:46:20 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:46:20 user nova-compute[75255]:   </clock>
Nov 14 11:46:20 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:46:20 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:46:20 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:46:20 user nova-compute[75255]:   </cpu>
Nov 14 11:46:20 user nova-compute[75255]:   <devices>
Nov 14 11:46:20 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:46:20 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:46:20 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk"/>
Nov 14 11:46:20 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:46:20 user nova-compute[75255]:     </disk>
Nov 14 11:46:20 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:46:20 user nova-compute[75255]:       <mac address="fa:16:3e:0b:ec:8e"/>
Nov 14 11:46:20 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:46:20 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:46:20 user nova-compute[75255]:       <target dev="tap66e9baab-82"/>
Nov 14 11:46:20 user nova-compute[75255]:     </interface>
Nov 14 11:46:20 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:46:20 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/console.log" append="off"/>
Nov 14 11:46:20 user nova-compute[75255]:     </serial>
Nov 14 11:46:20 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:46:20 user nova-compute[75255]:     <video>
Nov 14 11:46:20 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:46:20 user nova-compute[75255]:     </video>
Nov 14 11:46:20 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:46:20 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:46:20 user nova-compute[75255]:     </rng>
Nov 14 11:46:20 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:46:20 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:46:20 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:46:20 user nova-compute[75255]:     </memballoon>
Nov 14 11:46:20 user nova-compute[75255]:   </devices>
Nov 14 11:46:20 user nova-compute[75255]: </domain>
Nov 14 11:46:20 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:46:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.objects.base [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.177s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Cannot resize image /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.objects.instance [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'migration_context' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.objects.base [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Object Instance<3e0a66b6-b8ef-4804-8197-39eaa11bed2b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75255) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG os_vif [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99d33761-5596-50ec-97be-01ec57d99ef1', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66e9baab-82, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66e9baab-82, col_values=(('qos', UUID('deb2def1-627e-4ee6-8cb1-4e9baa05456a')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66e9baab-82, col_values=(('external_ids', {'iface-id': '66e9baab-8248-4e5e-aec3-d0745bfaebec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ec:8e', 'vm-uuid': '3e0a66b6-b8ef-4804-8197-39eaa11bed2b'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:46:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:21 user nova-compute[75255]: INFO os_vif [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82')
Nov 14 11:46:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fca44c2-f1eb-4bb3-ac90-963d6a8452cd req-6ed2c177-cec1-45e1-8460-492df50a9882 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fca44c2-f1eb-4bb3-ac90-963d6a8452cd req-6ed2c177-cec1-45e1-8460-492df50a9882 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fca44c2-f1eb-4bb3-ac90-963d6a8452cd req-6ed2c177-cec1-45e1-8460-492df50a9882 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fca44c2-f1eb-4bb3-ac90-963d6a8452cd req-6ed2c177-cec1-45e1-8460-492df50a9882 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fca44c2-f1eb-4bb3-ac90-963d6a8452cd req-6ed2c177-cec1-45e1-8460-492df50a9882 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:46:23 user nova-compute[75255]: WARNING nova.compute.manager [req-8fca44c2-f1eb-4bb3-ac90-963d6a8452cd req-6ed2c177-cec1-45e1-8460-492df50a9882 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state stopped and task_state powering-on.
Nov 14 11:46:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:46:25 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance rebooted successfully.
Nov 14 11:46:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-13353c18-e397-49f9-a3d9-86c359471440 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:46:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-76d7229c-6d1b-4dfd-9416-c044d1c7fd01 req-ec16d5c9-7a72-43c2-bb73-d1caaf1523c8 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:46:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76d7229c-6d1b-4dfd-9416-c044d1c7fd01 req-ec16d5c9-7a72-43c2-bb73-d1caaf1523c8 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:46:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76d7229c-6d1b-4dfd-9416-c044d1c7fd01 req-ec16d5c9-7a72-43c2-bb73-d1caaf1523c8 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:46:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-76d7229c-6d1b-4dfd-9416-c044d1c7fd01 req-ec16d5c9-7a72-43c2-bb73-d1caaf1523c8 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:46:25 user nova-compute[75255]: DEBUG nova.compute.manager [req-76d7229c-6d1b-4dfd-9416-c044d1c7fd01 req-ec16d5c9-7a72-43c2-bb73-d1caaf1523c8 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:46:25 user nova-compute[75255]: WARNING nova.compute.manager [req-76d7229c-6d1b-4dfd-9416-c044d1c7fd01 req-ec16d5c9-7a72-43c2-bb73-d1caaf1523c8 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state active and task_state None.
Nov 14 11:46:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:46:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:46:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:46:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:46:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:46:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:46:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:46:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:46:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:52 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:54 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:46:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:46:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:47:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:47:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:47:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:04 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:47:04 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:47:04 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=25.019184112548828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c15058da-9f64-4d23-b62b-f9fdef00c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:47:04 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:47:05 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:47:05 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:47:05 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:47:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:47:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:47:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:07 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:08 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:47:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:47:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:47:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating instance_info_cache with network_info: [{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:47:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:47:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:47:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:47:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:47:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-changed-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Refreshing instance network info cache due to event network-changed-a05c1b03-6fa0-46f8-860e-02cb0453f59a. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] Acquiring lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] Acquired lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Refreshing network info cache for port a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updated VIF entry in instance network info cache for port a05c1b03-6fa0-46f8-860e-02cb0453f59a. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG nova.network.neutron [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating instance_info_cache with network_info: [{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:47:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-a08cc356-736c-4e79-9402-7b03833e7074 req-f0455155-8abf-41ca-a748-bae5b36426d1 service nova] Releasing lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:47:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "5429f531-292d-463e-9db5-f478acb8875d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:47:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "5429f531-292d-463e-9db5-f478acb8875d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:47:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:47:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:47:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:47:22 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:47:22 user nova-compute[75255]: INFO nova.compute.claims [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Claim successful on node user
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:47:23 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.policy [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99569798a7b14c20ab22ed26a0b11fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae08eed848f44bda5da3485b0b6b374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:47:23 user nova-compute[75255]: INFO nova.virt.block_device [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Booting with volume f2a41d60-8707-407d-81c4-c2c7f1daf4d1 at /dev/vda
Nov 14 11:47:23 user nova-compute[75255]: DEBUG os_brick.utils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca51562-b7a0-48da-a03d-9301b09d7d70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5dc17b-68b2-4935-8079-d2084238df5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f575cb-7d32-4e9d-8162-16d62348f9f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2373d-f2eb-4838-be0d-330fda5ce262]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:47:23 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:47:23 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3b2d2-f697-410b-b5d3-46e8d12c5be6]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG os_brick.utils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:47:23 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updating existing volume attachment record: 3760671b-35aa-4453-be88-4977f675d81b {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Successfully created port: 1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Successfully updated port: 1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquired lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-changed-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG nova.compute.manager [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Refreshing instance network info cache due to event network-changed-1444994e-b8ac-4367-9f89-ed4cca75b67b. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] Acquiring lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:47:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updating instance_info_cache with network_info: [{"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Releasing lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Instance network_info: |[{"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] Acquired lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Refreshing network info cache for port 1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updated VIF entry in instance network info cache for port 1444994e-b8ac-4367-9f89-ed4cca75b67b. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG nova.network.neutron [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updating instance_info_cache with network_info: [{"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:47:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4830ffe5-5462-4784-8329-73bafc3b6f3c req-41a0d72d-5a1b-4170-9fa6-c50a7253e798 service nova] Releasing lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:47:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:47:27 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Creating image(s)
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Did not create local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Ensure instance console log exists: /opt/stack/data/nova/instances/5429f531-292d-463e-9db5-f478acb8875d/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Start _get_guest_xml network_info=[{"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '3760671b-35aa-4453-be88-4977f675d81b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxVjRETo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5429f531-292d-463e-9db5-f478acb8875d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2a41d60-8707-407d-81c4-c2c7f1daf4d1', 'serial': 'f2a41d60-8707-407d-81c4-c2c7f1daf4d1'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:47:27 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:47:27 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:47:27 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxVjRETo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:47:28 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:47:28 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:47:28 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c340eff5-4485-4d99-b8aa-a51dae4f61a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:47:28 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3de095c-18ed-42cb-954b-307ee1a8f59b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1] added
Nov 14 11:47:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa6f5d0-2418-41c9-8e09-670fd83f8963]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf3b2e1-cb04-4724-85d3-725547b0dcf2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxVjRETo {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxVjRETo" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74afee8-57fe-4afd-ab7b-3286a3408aaa]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sxVjRETo'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9005f136-3a3a-49fa-a973-c25870d824e8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccda238e-ec19-45e2-baa7-4accd8849b3a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:47:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:47:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[549eb91b-45be-4657-b503-c8d4fe3bad80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260]
Nov 14 11:47:28 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260] successful.
Nov 14 11:47:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ada23a-b1a1-4d92-975d-3770d5e8484f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c48ad8-e432-4edd-8c84-81311c3fcc35]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:47:28 user nova-compute[75255]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 (non-flash)
Nov 14 11:47:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:47:28 user nova-compute[75255]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 (non-flash)
Nov 14 11:47:28 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbb892-2a16-40da-b248-44e88087116a]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:47:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxVjRETo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26639653039653962', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639653039653962', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1843350930',display_name='tempest-TestVolumeBootPattern-server-1843350930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1843350930',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-eh48wybq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:47:23Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=5429f531-292d-463e-9db5-f478acb8875d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=1444994e-b8ac-4367-9f89-ed4cca75b67b,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1444994e-b8') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.objects.instance [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'pci_devices' on Instance uuid 5429f531-292d-463e-9db5-f478acb8875d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:47:29 user nova-compute[75255]:   <uuid>5429f531-292d-463e-9db5-f478acb8875d</uuid>
Nov 14 11:47:29 user nova-compute[75255]:   <name>instance-00000033</name>
Nov 14 11:47:29 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:47:29 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:47:29 user nova-compute[75255]:   <metadata>
Nov 14 11:47:29 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:47:29 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:47:29 user nova-compute[75255]:       <nova:name>tempest-TestVolumeBootPattern-server-1843350930</nova:name>
Nov 14 11:47:29 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:47:27</nova:creationTime>
Nov 14 11:47:29 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:47:29 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:47:29 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:47:29 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:47:29 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:47:29 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:47:29 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:47:29 user nova-compute[75255]:       <nova:owner>
Nov 14 11:47:29 user nova-compute[75255]:         <nova:user uuid="99569798a7b14c20ab22ed26a0b11fd2">tempest-TestVolumeBootPattern-1575864965-project-member</nova:user>
Nov 14 11:47:29 user nova-compute[75255]:         <nova:project uuid="5ae08eed848f44bda5da3485b0b6b374">tempest-TestVolumeBootPattern-1575864965</nova:project>
Nov 14 11:47:29 user nova-compute[75255]:       </nova:owner>
Nov 14 11:47:29 user nova-compute[75255]:       <nova:ports>
Nov 14 11:47:29 user nova-compute[75255]:         <nova:port uuid="1444994e-b8ac-4367-9f89-ed4cca75b67b">
Nov 14 11:47:29 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 11:47:29 user nova-compute[75255]:         </nova:port>
Nov 14 11:47:29 user nova-compute[75255]:       </nova:ports>
Nov 14 11:47:29 user nova-compute[75255]:     </nova:instance>
Nov 14 11:47:29 user nova-compute[75255]:   </metadata>
Nov 14 11:47:29 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:47:29 user nova-compute[75255]:     <system>
Nov 14 11:47:29 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:47:29 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:47:29 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:47:29 user nova-compute[75255]:       <entry name="serial">5429f531-292d-463e-9db5-f478acb8875d</entry>
Nov 14 11:47:29 user nova-compute[75255]:       <entry name="uuid">5429f531-292d-463e-9db5-f478acb8875d</entry>
Nov 14 11:47:29 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:47:29 user nova-compute[75255]:     </system>
Nov 14 11:47:29 user nova-compute[75255]:   </sysinfo>
Nov 14 11:47:29 user nova-compute[75255]:   <os>
Nov 14 11:47:29 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:47:29 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:47:29 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:47:29 user nova-compute[75255]:   </os>
Nov 14 11:47:29 user nova-compute[75255]:   <features>
Nov 14 11:47:29 user nova-compute[75255]:     <acpi/>
Nov 14 11:47:29 user nova-compute[75255]:     <apic/>
Nov 14 11:47:29 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:47:29 user nova-compute[75255]:   </features>
Nov 14 11:47:29 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:47:29 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:47:29 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:47:29 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:47:29 user nova-compute[75255]:   </clock>
Nov 14 11:47:29 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:47:29 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:47:29 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:47:29 user nova-compute[75255]:   </cpu>
Nov 14 11:47:29 user nova-compute[75255]:   <devices>
Nov 14 11:47:29 user nova-compute[75255]:     <disk type="block" device="disk">
Nov 14 11:47:29 user nova-compute[75255]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:47:29 user nova-compute[75255]:       <source dev="/dev/sdc"/>
Nov 14 11:47:29 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:47:29 user nova-compute[75255]:       <serial>f2a41d60-8707-407d-81c4-c2c7f1daf4d1</serial>
Nov 14 11:47:29 user nova-compute[75255]:     </disk>
Nov 14 11:47:29 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:47:29 user nova-compute[75255]:       <mac address="fa:16:3e:6d:1d:70"/>
Nov 14 11:47:29 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:47:29 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:47:29 user nova-compute[75255]:       <target dev="tap1444994e-b8"/>
Nov 14 11:47:29 user nova-compute[75255]:     </interface>
Nov 14 11:47:29 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:47:29 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/5429f531-292d-463e-9db5-f478acb8875d/console.log" append="off"/>
Nov 14 11:47:29 user nova-compute[75255]:     </serial>
Nov 14 11:47:29 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:47:29 user nova-compute[75255]:     <video>
Nov 14 11:47:29 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:47:29 user nova-compute[75255]:     </video>
Nov 14 11:47:29 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:47:29 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:47:29 user nova-compute[75255]:     </rng>
Nov 14 11:47:29 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:47:29 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:47:29 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:47:29 user nova-compute[75255]:     </memballoon>
Nov 14 11:47:29 user nova-compute[75255]:   </devices>
Nov 14 11:47:29 user nova-compute[75255]: </domain>
Nov 14 11:47:29 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1843350930',display_name='tempest-TestVolumeBootPattern-server-1843350930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1843350930',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-eh48wybq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:47:23Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=5429f531-292d-463e-9db5-f478acb8875d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=1444994e-b8ac-4367-9f89-ed4cca75b67b,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1444994e-b8') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG os_vif [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=1444994e-b8ac-4367-9f89-ed4cca75b67b,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1444994e-b8') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5f8a7e2-ad93-58a4-8fdb-04c9f19c29e7', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1444994e-b8, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1444994e-b8, col_values=(('qos', UUID('0428ccf8-b8c6-4fe6-a12c-edbda5bf446b')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1444994e-b8, col_values=(('external_ids', {'iface-id': '1444994e-b8ac-4367-9f89-ed4cca75b67b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:1d:70', 'vm-uuid': '5429f531-292d-463e-9db5-f478acb8875d'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:29 user nova-compute[75255]: INFO os_vif [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=1444994e-b8ac-4367-9f89-ed4cca75b67b,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1444994e-b8')
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:47:29 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] No VIF found with MAC fa:16:3e:6d:1d:70, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-929517ba-7e27-48ed-a156-e0a1aa6981d2 req-672c5dfa-1d04-4251-9992-18a128ed185c service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-929517ba-7e27-48ed-a156-e0a1aa6981d2 req-672c5dfa-1d04-4251-9992-18a128ed185c service nova] Acquiring lock "5429f531-292d-463e-9db5-f478acb8875d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-929517ba-7e27-48ed-a156-e0a1aa6981d2 req-672c5dfa-1d04-4251-9992-18a128ed185c service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-929517ba-7e27-48ed-a156-e0a1aa6981d2 req-672c5dfa-1d04-4251-9992-18a128ed185c service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG nova.compute.manager [req-929517ba-7e27-48ed-a156-e0a1aa6981d2 req-672c5dfa-1d04-4251-9992-18a128ed185c service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] No waiting events found dispatching network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:47:30 user nova-compute[75255]: WARNING nova.compute.manager [req-929517ba-7e27-48ed-a156-e0a1aa6981d2 req-672c5dfa-1d04-4251-9992-18a128ed185c service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received unexpected event network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b for instance with vm_state building and task_state spawning.
Nov 14 11:47:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:47:32 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Instance spawned successfully.
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:47:32 user nova-compute[75255]: INFO nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Took 4.85 seconds to spawn the instance on the hypervisor.
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fb116c4-c449-4642-b4b2-5a9484229f36 req-446b9a8e-2986-4904-a75d-ed30f87237a8 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fb116c4-c449-4642-b4b2-5a9484229f36 req-446b9a8e-2986-4904-a75d-ed30f87237a8 service nova] Acquiring lock "5429f531-292d-463e-9db5-f478acb8875d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fb116c4-c449-4642-b4b2-5a9484229f36 req-446b9a8e-2986-4904-a75d-ed30f87237a8 service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-8fb116c4-c449-4642-b4b2-5a9484229f36 req-446b9a8e-2986-4904-a75d-ed30f87237a8 service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:47:32 user nova-compute[75255]: DEBUG nova.compute.manager [req-8fb116c4-c449-4642-b4b2-5a9484229f36 req-446b9a8e-2986-4904-a75d-ed30f87237a8 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] No waiting events found dispatching network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:47:32 user nova-compute[75255]: WARNING nova.compute.manager [req-8fb116c4-c449-4642-b4b2-5a9484229f36 req-446b9a8e-2986-4904-a75d-ed30f87237a8 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received unexpected event network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b for instance with vm_state building and task_state spawning.
Nov 14 11:47:32 user nova-compute[75255]: INFO nova.compute.manager [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Took 9.99 seconds to build instance.
Nov 14 11:47:32 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c8839576-a701-40b1-9efc-86758ab683ab tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "5429f531-292d-463e-9db5-f478acb8875d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.205s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:47:34 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:44 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:49 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:47:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:54 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:54 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:47:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:47:59 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:04 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:48:06 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:48:06 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:48:06 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=25.009552001953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:48:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c15058da-9f64-4d23-b62b-f9fdef00c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5429f531-292d-463e-9db5-f478acb8875d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:48:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:48:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:48:11 user nova-compute[75255]: INFO nova.compute.manager [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Terminating instance
Nov 14 11:48:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-82b4b071-b5b7-4b75-9307-677a483f83a5 req-c68f345a-5a6d-4b82-80b9-6a909c5a1100 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82b4b071-b5b7-4b75-9307-677a483f83a5 req-c68f345a-5a6d-4b82-80b9-6a909c5a1100 service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82b4b071-b5b7-4b75-9307-677a483f83a5 req-c68f345a-5a6d-4b82-80b9-6a909c5a1100 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-82b4b071-b5b7-4b75-9307-677a483f83a5 req-c68f345a-5a6d-4b82-80b9-6a909c5a1100 service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-82b4b071-b5b7-4b75-9307-677a483f83a5 req-c68f345a-5a6d-4b82-80b9-6a909c5a1100 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-82b4b071-b5b7-4b75-9307-677a483f83a5 req-c68f345a-5a6d-4b82-80b9-6a909c5a1100 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-unplugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:48:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance destroyed successfully.
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.objects.instance [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'resources' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911577971',display_name='tempest-AttachVolumeTestJSON-server-1911577971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911577971',id=46,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZSdXdkUnNXo9e8ggYGLhJJn7qKqcLzOmVDuIqhhc2We/6WipNse5wYiGrgNiWP7XGf7V9o/Orp4l4r3OLpajRCFXTslCV5ytEZwxoP2GdjcxXlNsfNUr0WzK3oC0SKgg==',key_name='tempest-keypair-234571835',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-oht1bwz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=3e0a66b6-b8ef-4804-8197-39eaa11bed2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "address": "fa:16:3e:0b:ec:8e", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e9baab-82", "ovs_interfaceid": "66e9baab-8248-4e5e-aec3-d0745bfaebec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG os_vif [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66e9baab-82, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=deb2def1-627e-4ee6-8cb1-4e9baa05456a) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:12 user nova-compute[75255]: INFO os_vif [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:8e,bridge_name='br-int',has_traffic_filtering=True,id=66e9baab-8248-4e5e-aec3-d0745bfaebec,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e9baab-82')
Nov 14 11:48:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Deleting instance files /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b_del
Nov 14 11:48:12 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Deletion of /opt/stack/data/nova/instances/3e0a66b6-b8ef-4804-8197-39eaa11bed2b_del complete
Nov 14 11:48:12 user nova-compute[75255]: INFO nova.compute.manager [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 14 11:48:12 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:48:12 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Took 0.64 seconds to deallocate network for instance.
Nov 14 11:48:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:48:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-f49755d8-8b0f-4d96-ad8e-7982cebb6359 req-aaaa5e0b-38a0-4b39-a39f-e0bd1097a387 service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-deleted-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 3e0a66b6-b8ef-4804-8197-39eaa11bed2b {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:48:13 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Deleted allocations for instance 3e0a66b6-b8ef-4804-8197-39eaa11bed2b
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-42dc7905-ac6e-408f-940d-d478c96438ee tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.809s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-3e0a66b6-b8ef-4804-8197-39eaa11bed2b" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-2df930d9-4986-4a38-b22c-625901a11c8e req-dbf7f671-44c9-4401-b227-531a5953b3ef service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2df930d9-4986-4a38-b22c-625901a11c8e req-dbf7f671-44c9-4401-b227-531a5953b3ef service nova] Acquiring lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2df930d9-4986-4a38-b22c-625901a11c8e req-dbf7f671-44c9-4401-b227-531a5953b3ef service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-2df930d9-4986-4a38-b22c-625901a11c8e req-dbf7f671-44c9-4401-b227-531a5953b3ef service nova] Lock "3e0a66b6-b8ef-4804-8197-39eaa11bed2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:48:13 user nova-compute[75255]: DEBUG nova.compute.manager [req-2df930d9-4986-4a38-b22c-625901a11c8e req-dbf7f671-44c9-4401-b227-531a5953b3ef service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] No waiting events found dispatching network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:48:13 user nova-compute[75255]: WARNING nova.compute.manager [req-2df930d9-4986-4a38-b22c-625901a11c8e req-dbf7f671-44c9-4401-b227-531a5953b3ef service nova] [instance: 3e0a66b6-b8ef-4804-8197-39eaa11bed2b] Received unexpected event network-vif-plugged-66e9baab-8248-4e5e-aec3-d0745bfaebec for instance with vm_state deleted and task_state None.
Nov 14 11:48:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:48:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:48:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:48:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:48:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:48:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:48:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:48:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:48:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:48:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:48:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:48:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:48:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:48:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:56 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:48:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:48:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:49:05 user nova-compute[75255]: INFO nova.compute.claims [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Claim successful on node user
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:49:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.policy [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd508f30ed89a4451a0a383019d98dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32711b26ee74011b2733543d7c60c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:49:05 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Creating image(s)
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "/opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "/opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:05 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk 1073741824" returned: 0 in 0.058s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Successfully created port: 50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Cannot resize image /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Ensure instance console log exists: /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:06 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Successfully updated port: 50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquired lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-changed-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.compute.manager [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Refreshing instance network info cache due to event network-changed-50d1baef-accb-499c-9a2e-150c63ce7345. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] Acquiring lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.neutron [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updating instance_info_cache with network_info: [{"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Releasing lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Instance network_info: |[{"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] Acquired lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Refreshing network info cache for port 50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Start _get_guest_xml network_info=[{"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:49:07 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:49:07 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-512739948',display_name='tempest-AttachVolumeTestJSON-server-512739948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-512739948',id=52,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdxa1jwtLtVoIssCtwhh1EZPcT+KBCfULjtRqGyVqxCM9ImQEjz+KLlq5QCavC++kdGAO0gRyX5KCKZ/eXuKsXQIBPDQYLAJp7ewDrU5g40RuAMgCCybLYncdOeQ1tqdQ==',key_name='tempest-keypair-1122751931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-nb0cvsv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=50d1baef-accb-499c-9a2e-150c63ce7345,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d1baef-ac') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'pci_devices' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:49:07 user nova-compute[75255]:   <uuid>e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc</uuid>
Nov 14 11:49:07 user nova-compute[75255]:   <name>instance-00000034</name>
Nov 14 11:49:07 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:49:07 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:49:07 user nova-compute[75255]:   <metadata>
Nov 14 11:49:07 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:49:07 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:49:07 user nova-compute[75255]:       <nova:name>tempest-AttachVolumeTestJSON-server-512739948</nova:name>
Nov 14 11:49:07 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:49:07</nova:creationTime>
Nov 14 11:49:07 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:49:07 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:49:07 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:49:07 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:49:07 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:49:07 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:49:07 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:49:07 user nova-compute[75255]:       <nova:owner>
Nov 14 11:49:07 user nova-compute[75255]:         <nova:user uuid="d508f30ed89a4451a0a383019d98dae4">tempest-AttachVolumeTestJSON-545907524-project-member</nova:user>
Nov 14 11:49:07 user nova-compute[75255]:         <nova:project uuid="f32711b26ee74011b2733543d7c60c81">tempest-AttachVolumeTestJSON-545907524</nova:project>
Nov 14 11:49:07 user nova-compute[75255]:       </nova:owner>
Nov 14 11:49:07 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:49:07 user nova-compute[75255]:       <nova:ports>
Nov 14 11:49:07 user nova-compute[75255]:         <nova:port uuid="50d1baef-accb-499c-9a2e-150c63ce7345">
Nov 14 11:49:07 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 11:49:07 user nova-compute[75255]:         </nova:port>
Nov 14 11:49:07 user nova-compute[75255]:       </nova:ports>
Nov 14 11:49:07 user nova-compute[75255]:     </nova:instance>
Nov 14 11:49:07 user nova-compute[75255]:   </metadata>
Nov 14 11:49:07 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:49:07 user nova-compute[75255]:     <system>
Nov 14 11:49:07 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:49:07 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:49:07 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:49:07 user nova-compute[75255]:       <entry name="serial">e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc</entry>
Nov 14 11:49:07 user nova-compute[75255]:       <entry name="uuid">e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc</entry>
Nov 14 11:49:07 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:49:07 user nova-compute[75255]:     </system>
Nov 14 11:49:07 user nova-compute[75255]:   </sysinfo>
Nov 14 11:49:07 user nova-compute[75255]:   <os>
Nov 14 11:49:07 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:49:07 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:49:07 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:49:07 user nova-compute[75255]:   </os>
Nov 14 11:49:07 user nova-compute[75255]:   <features>
Nov 14 11:49:07 user nova-compute[75255]:     <acpi/>
Nov 14 11:49:07 user nova-compute[75255]:     <apic/>
Nov 14 11:49:07 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:49:07 user nova-compute[75255]:   </features>
Nov 14 11:49:07 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:49:07 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:49:07 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:49:07 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:49:07 user nova-compute[75255]:   </clock>
Nov 14 11:49:07 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:49:07 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:49:07 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:49:07 user nova-compute[75255]:   </cpu>
Nov 14 11:49:07 user nova-compute[75255]:   <devices>
Nov 14 11:49:07 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:49:07 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:49:07 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk"/>
Nov 14 11:49:07 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:49:07 user nova-compute[75255]:     </disk>
Nov 14 11:49:07 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:49:07 user nova-compute[75255]:       <mac address="fa:16:3e:7c:4b:88"/>
Nov 14 11:49:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:49:07 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:49:07 user nova-compute[75255]:       <target dev="tap50d1baef-ac"/>
Nov 14 11:49:07 user nova-compute[75255]:     </interface>
Nov 14 11:49:07 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:49:07 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/console.log" append="off"/>
Nov 14 11:49:07 user nova-compute[75255]:     </serial>
Nov 14 11:49:07 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:49:07 user nova-compute[75255]:     <video>
Nov 14 11:49:07 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:49:07 user nova-compute[75255]:     </video>
Nov 14 11:49:07 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:49:07 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:49:07 user nova-compute[75255]:     </rng>
Nov 14 11:49:07 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:49:07 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:49:07 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:49:07 user nova-compute[75255]:     </memballoon>
Nov 14 11:49:07 user nova-compute[75255]:   </devices>
Nov 14 11:49:07 user nova-compute[75255]: </domain>
Nov 14 11:49:07 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-512739948',display_name='tempest-AttachVolumeTestJSON-server-512739948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-512739948',id=52,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdxa1jwtLtVoIssCtwhh1EZPcT+KBCfULjtRqGyVqxCM9ImQEjz+KLlq5QCavC++kdGAO0gRyX5KCKZ/eXuKsXQIBPDQYLAJp7ewDrU5g40RuAMgCCybLYncdOeQ1tqdQ==',key_name='tempest-keypair-1122751931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-nb0cvsv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=50d1baef-accb-499c-9a2e-150c63ce7345,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d1baef-ac') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG os_vif [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=50d1baef-accb-499c-9a2e-150c63ce7345,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d1baef-ac') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca8045d1-d6f9-54fb-b2af-ed26abaa97fc', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50d1baef-ac, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50d1baef-ac, col_values=(('qos', UUID('2a30a985-7325-4903-b2a1-8946437887f5')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50d1baef-ac, col_values=(('external_ids', {'iface-id': '50d1baef-accb-499c-9a2e-150c63ce7345', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:4b:88', 'vm-uuid': 'e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:07 user nova-compute[75255]: INFO os_vif [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=50d1baef-accb-499c-9a2e-150c63ce7345,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d1baef-ac')
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No VIF found with MAC fa:16:3e:7c:4b:88, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updated VIF entry in instance network info cache for port 50d1baef-accb-499c-9a2e-150c63ce7345. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG nova.network.neutron [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updating instance_info_cache with network_info: [{"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:49:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-b4bf035b-ac45-469e-96e6-ca72dddd62e7 req-7aa08d3a-1ebe-4791-8813-30588b969e5a service nova] Releasing lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-1a0c3628-dec7-4ed8-8899-946b6fa323d8 req-cd1e5581-6ba8-4fda-90d7-393f58ed96ce service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1a0c3628-dec7-4ed8-8899-946b6fa323d8 req-cd1e5581-6ba8-4fda-90d7-393f58ed96ce service nova] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1a0c3628-dec7-4ed8-8899-946b6fa323d8 req-cd1e5581-6ba8-4fda-90d7-393f58ed96ce service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1a0c3628-dec7-4ed8-8899-946b6fa323d8 req-cd1e5581-6ba8-4fda-90d7-393f58ed96ce service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-1a0c3628-dec7-4ed8-8899-946b6fa323d8 req-cd1e5581-6ba8-4fda-90d7-393f58ed96ce service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] No waiting events found dispatching network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:49:09 user nova-compute[75255]: WARNING nova.compute.manager [req-1a0c3628-dec7-4ed8-8899-946b6fa323d8 req-cd1e5581-6ba8-4fda-90d7-393f58ed96ce service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received unexpected event network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 for instance with vm_state building and task_state spawning.
Nov 14 11:49:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-9f7c253f-1e75-4c6e-8695-ca3d3a502e83 req-0d39f111-8fec-4c81-899b-0f1a92cadc49 service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9f7c253f-1e75-4c6e-8695-ca3d3a502e83 req-0d39f111-8fec-4c81-899b-0f1a92cadc49 service nova] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9f7c253f-1e75-4c6e-8695-ca3d3a502e83 req-0d39f111-8fec-4c81-899b-0f1a92cadc49 service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9f7c253f-1e75-4c6e-8695-ca3d3a502e83 req-0d39f111-8fec-4c81-899b-0f1a92cadc49 service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.manager [req-9f7c253f-1e75-4c6e-8695-ca3d3a502e83 req-0d39f111-8fec-4c81-899b-0f1a92cadc49 service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] No waiting events found dispatching network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:49:11 user nova-compute[75255]: WARNING nova.compute.manager [req-9f7c253f-1e75-4c6e-8695-ca3d3a502e83 req-0d39f111-8fec-4c81-899b-0f1a92cadc49 service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received unexpected event network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 for instance with vm_state building and task_state spawning.
Nov 14 11:49:11 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:49:11 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.03607177734375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Instance spawned successfully.
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c15058da-9f64-4d23-b62b-f9fdef00c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 5429f531-292d-463e-9db5-f478acb8875d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:49:11 user nova-compute[75255]: INFO nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:49:11 user nova-compute[75255]: INFO nova.compute.manager [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Took 6.23 seconds to build instance.
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d0453b20-fce7-4a51-8020-86b21703636a tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.340s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:49:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating instance_info_cache with network_info: [{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:49:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-changed-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG nova.compute.manager [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Refreshing instance network info cache due to event network-changed-1444994e-b8ac-4367-9f89-ed4cca75b67b. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] Acquiring lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] Acquired lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Refreshing network info cache for port 1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updated VIF entry in instance network info cache for port 1444994e-b8ac-4367-9f89-ed4cca75b67b. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG nova.network.neutron [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updating instance_info_cache with network_info: [{"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:49:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-7aeec7d1-6017-47dc-96d3-12340d7d4146 req-9e6661b6-02f4-4a3f-b1a1-deecb24cfba5 service nova] Releasing lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "5429f531-292d-463e-9db5-f478acb8875d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "5429f531-292d-463e-9db5-f478acb8875d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "5429f531-292d-463e-9db5-f478acb8875d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:15 user nova-compute[75255]: INFO nova.compute.manager [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Terminating instance
Nov 14 11:49:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-31e5c24e-ba22-46f4-b558-a80bb52219a2 req-3a12b550-385d-4e1e-8873-c55b36a8cdc0 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-vif-unplugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-31e5c24e-ba22-46f4-b558-a80bb52219a2 req-3a12b550-385d-4e1e-8873-c55b36a8cdc0 service nova] Acquiring lock "5429f531-292d-463e-9db5-f478acb8875d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-31e5c24e-ba22-46f4-b558-a80bb52219a2 req-3a12b550-385d-4e1e-8873-c55b36a8cdc0 service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-31e5c24e-ba22-46f4-b558-a80bb52219a2 req-3a12b550-385d-4e1e-8873-c55b36a8cdc0 service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-31e5c24e-ba22-46f4-b558-a80bb52219a2 req-3a12b550-385d-4e1e-8873-c55b36a8cdc0 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] No waiting events found dispatching network-vif-unplugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG nova.compute.manager [req-31e5c24e-ba22-46f4-b558-a80bb52219a2 req-3a12b550-385d-4e1e-8873-c55b36a8cdc0 service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-vif-unplugged-1444994e-b8ac-4367-9f89-ed4cca75b67b for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Instance destroyed successfully.
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'resources' on Instance uuid 5429f531-292d-463e-9db5-f478acb8875d {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1843350930',display_name='tempest-TestVolumeBootPattern-server-1843350930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1843350930',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:47:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-eh48wybq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:47:33Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=5429f531-292d-463e-9db5-f478acb8875d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=1444994e-b8ac-4367-9f89-ed4cca75b67b,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1444994e-b8') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_vif [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=1444994e-b8ac-4367-9f89-ed4cca75b67b,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1444994e-b8') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1444994e-b8, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0428ccf8-b8c6-4fe6-a12c-edbda5bf446b) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:49:16 user nova-compute[75255]: INFO os_vif [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=1444994e-b8ac-4367-9f89-ed4cca75b67b,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1444994e-b8')
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxVjRETo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:49:16 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[444a593c-95da-466a-a8a9-b17be01ed82c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:49:16 user nova-compute[75255]: No targets found.
Nov 14 11:49:16 user nova-compute[75255]: iSNS:
Nov 14 11:49:16 user nova-compute[75255]: No targets found.
Nov 14 11:49:16 user nova-compute[75255]: STATIC:
Nov 14 11:49:16 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1
Nov 14 11:49:16 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:49:16 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:49:16 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e
Nov 14 11:49:16 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:49:16 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:49:16 user nova-compute[75255]: FIRMWARE:
Nov 14 11:49:16 user nova-compute[75255]: No targets found.
Nov 14 11:49:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:49:16 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:49:16 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb28ce2-2d4f-4933-a397-3c6004687e69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772b360-cbb3-4063-b7fc-c416b4f14554]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:49:16 user nova-compute[75255]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 (non-flash)
Nov 14 11:49:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:49:16 user nova-compute[75255]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 (non-flash)
Nov 14 11:49:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff328222200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9dd3b7-3330-409d-afcc-5b20b0b5d128]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b88aa8-d420-4468-b0b7-852a17fdf60a]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[216920ed-fbd4-4581-a834-a6c6ffd570e8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f005839-3c8a-47d1-91f4-18f5eda4ee1e]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb1e2f-5e60-4746-8b86-fbf958dcda79]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f9157f-7042-416b-bd81-b11195e034b7]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260]
Nov 14 11:49:16 user nova-compute[75255]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1, portal: 172.16.0.220,3260] successful.
Nov 14 11:49:16 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a41d60-8707-407d-81c4-c2c7f1daf4d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9405f48-3fc3-4971-baee-4bc9aad02008]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== disconnect_volume: return (350ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:49:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Deleting instance files /opt/stack/data/nova/instances/5429f531-292d-463e-9db5-f478acb8875d_del
Nov 14 11:49:16 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Deletion of /opt/stack/data/nova/instances/5429f531-292d-463e-9db5-f478acb8875d_del complete
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-changed-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.compute.manager [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Refreshing instance network info cache due to event network-changed-1444994e-b8ac-4367-9f89-ed4cca75b67b. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] Acquiring lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] Acquired lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Refreshing network info cache for port 1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:49:16 user nova-compute[75255]: INFO nova.compute.manager [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 5429f531-292d-463e-9db5-f478acb8875d] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updated VIF entry in instance network info cache for port 1444994e-b8ac-4367-9f89-ed4cca75b67b. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.network.neutron [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updating instance_info_cache with network_info: [{"id": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "address": "fa:16:3e:6d:1d:70", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1444994e-b8", "ovs_interfaceid": "1444994e-b8ac-4367-9f89-ed4cca75b67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-dc4b5b6e-442e-4bb1-9064-dde0395e8165 req-76614a4d-ff91-4fa4-a1a9-5ec9fbd9d28b service nova] Releasing lock "refresh_cache-5429f531-292d-463e-9db5-f478acb8875d" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:49:16 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:49:16 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Took 0.45 seconds to deallocate network for instance.
Nov 14 11:49:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-fa70f53f-6417-442c-8d10-46f01427f5e7 req-260aa8d9-f3c8-43b9-a2e7-797eff33aeaf service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fa70f53f-6417-442c-8d10-46f01427f5e7 req-260aa8d9-f3c8-43b9-a2e7-797eff33aeaf service nova] Acquiring lock "5429f531-292d-463e-9db5-f478acb8875d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fa70f53f-6417-442c-8d10-46f01427f5e7 req-260aa8d9-f3c8-43b9-a2e7-797eff33aeaf service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-fa70f53f-6417-442c-8d10-46f01427f5e7 req-260aa8d9-f3c8-43b9-a2e7-797eff33aeaf service nova] Lock "5429f531-292d-463e-9db5-f478acb8875d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG nova.compute.manager [req-fa70f53f-6417-442c-8d10-46f01427f5e7 req-260aa8d9-f3c8-43b9-a2e7-797eff33aeaf service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] No waiting events found dispatching network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:49:17 user nova-compute[75255]: WARNING nova.compute.manager [req-fa70f53f-6417-442c-8d10-46f01427f5e7 req-260aa8d9-f3c8-43b9-a2e7-797eff33aeaf service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received unexpected event network-vif-plugged-1444994e-b8ac-4367-9f89-ed4cca75b67b for instance with vm_state active and task_state deleting.
Nov 14 11:49:17 user nova-compute[75255]: INFO nova.compute.manager [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 11:49:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:49:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:17 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Deleted allocations for instance 5429f531-292d-463e-9db5-f478acb8875d
Nov 14 11:49:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-27aac187-0b21-44c5-b9c4-72d2574d3547 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "5429f531-292d-463e-9db5-f478acb8875d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.680s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:49:18 user nova-compute[75255]: DEBUG nova.compute.manager [req-e650c088-652f-40c7-8530-68c803e35021 req-84ecb391-c15c-4d33-b24e-637b96021cba service nova] [instance: 5429f531-292d-463e-9db5-f478acb8875d] Received event network-vif-deleted-1444994e-b8ac-4367-9f89-ed4cca75b67b {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:49:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:49:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:49:57 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:50:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:50:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:50:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:50:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-changed-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG nova.compute.manager [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Refreshing instance network info cache due to event network-changed-a05c1b03-6fa0-46f8-860e-02cb0453f59a. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] Acquiring lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] Acquired lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG nova.network.neutron [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Refreshing network info cache for port a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:50:09 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:50:09 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:50:09 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.006759643554688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:09 user nova-compute[75255]: INFO nova.compute.manager [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Terminating instance
Nov 14 11:50:09 user nova-compute[75255]: DEBUG nova.compute.manager [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:50:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance c15058da-9f64-4d23-b62b-f9fdef00c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-5741324a-7ae4-4c44-87b5-01d5f6768708 req-f297d2f6-6bf5-4e14-9840-8f2847599edf service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-vif-unplugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5741324a-7ae4-4c44-87b5-01d5f6768708 req-f297d2f6-6bf5-4e14-9840-8f2847599edf service nova] Acquiring lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5741324a-7ae4-4c44-87b5-01d5f6768708 req-f297d2f6-6bf5-4e14-9840-8f2847599edf service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5741324a-7ae4-4c44-87b5-01d5f6768708 req-f297d2f6-6bf5-4e14-9840-8f2847599edf service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-5741324a-7ae4-4c44-87b5-01d5f6768708 req-f297d2f6-6bf5-4e14-9840-8f2847599edf service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] No waiting events found dispatching network-vif-unplugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.compute.manager [req-5741324a-7ae4-4c44-87b5-01d5f6768708 req-f297d2f6-6bf5-4e14-9840-8f2847599edf service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-vif-unplugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updated VIF entry in instance network info cache for port a05c1b03-6fa0-46f8-860e-02cb0453f59a. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.network.neutron [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating instance_info_cache with network_info: [{"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-4b31b0e6-0909-4904-89bb-477670b2a4bd req-90db8e12-3fd9-4501-859e-5f2bdecf4403 service nova] Releasing lock "refresh_cache-c15058da-9f64-4d23-b62b-f9fdef00c4b2" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:50:10 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Instance destroyed successfully.
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.objects.instance [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lazy-loading 'resources' on Instance uuid c15058da-9f64-4d23-b62b-f9fdef00c4b2 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-294864733',display_name='tempest-TestVolumeBootPattern-server-294864733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-294864733',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2PSAsLY0kwdQsadf4voh+dJgw2VPY26atV+yeXUqW0zj+mgktSqumMBNm/oyQ2ItjioVX5EtUus6QdbqgEo5R358/kCWNZdxiHXmafdRYwk3K/UQ8h4NdIBjalh9Z5bw==',key_name='tempest-TestVolumeBootPattern-2049404269',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ae08eed848f44bda5da3485b0b6b374',ramdisk_id='',reservation_id='r-802480bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1575864965',owner_user_name='tempest-TestVolumeBootPattern-1575864965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:45:36Z,user_data=None,user_id='99569798a7b14c20ab22ed26a0b11fd2',uuid=c15058da-9f64-4d23-b62b-f9fdef00c4b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converting VIF {"id": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "address": "fa:16:3e:d8:11:e8", "network": {"id": "df0134bd-4e6c-4154-a582-aa75c9989c94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-903612224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ae08eed848f44bda5da3485b0b6b374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05c1b03-6f", "ovs_interfaceid": "a05c1b03-6fa0-46f8-860e-02cb0453f59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:11:e8,bridge_name='br-int',has_traffic_filtering=True,id=a05c1b03-6fa0-46f8-860e-02cb0453f59a,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05c1b03-6f') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_vif [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:11:e8,bridge_name='br-int',has_traffic_filtering=True,id=a05c1b03-6fa0-46f8-860e-02cb0453f59a,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05c1b03-6f') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa05c1b03-6f, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5afa39b-756c-450c-8880-6ca6bfebc9fd) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:50:10 user nova-compute[75255]: INFO os_vif [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:11:e8,bridge_name='br-int',has_traffic_filtering=True,id=a05c1b03-6fa0-46f8-860e-02cb0453f59a,network=Network(df0134bd-4e6c-4154-a582-aa75c9989c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05c1b03-6f')
Nov 14 11:50:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfDbSrpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:50:10 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8566adf0-5c37-4ace-b956-a152a3481006]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:50:10 user nova-compute[75255]: No targets found.
Nov 14 11:50:10 user nova-compute[75255]: iSNS:
Nov 14 11:50:10 user nova-compute[75255]: No targets found.
Nov 14 11:50:10 user nova-compute[75255]: STATIC:
Nov 14 11:50:10 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e
Nov 14 11:50:10 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:50:10 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:50:10 user nova-compute[75255]: FIRMWARE:
Nov 14 11:50:10 user nova-compute[75255]: No targets found.
Nov 14 11:50:10 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:50:10 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:50:10 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d350902-6504-478e-b0fb-0a7dd430e0c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[429931cc-63f7-44a2-9f69-a9066ca2b373]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:50:10 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e (non-flash)
Nov 14 11:50:10 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3281a9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fff40b-c05a-4e0d-8b43-5e6203115f4c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[600072ec-0432-4b83-86a2-695a97aa2578]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[598b06ee-f709-43cf-bbe5-f8e71be6969a]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6bd8f9-89e9-4f47-9fc7-59f8b0bdc2cb]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeb599c-b593-425d-9679-f3f18e6f3179]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:50:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb43940c-663a-426d-b197-7c8cb9d6449a]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260]
Nov 14 11:50:11 user nova-compute[75255]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e, portal: 172.16.0.220,3260] successful.
Nov 14 11:50:11 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:034a5277-fceb-4a3b-aa22-732b1ac9f99e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[60411db4-219c-4d5e-8a28-60ee1abd10d4]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] <== disconnect_volume: return (305ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:50:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Deleting instance files /opt/stack/data/nova/instances/c15058da-9f64-4d23-b62b-f9fdef00c4b2_del
Nov 14 11:50:11 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Deletion of /opt/stack/data/nova/instances/c15058da-9f64-4d23-b62b-f9fdef00c4b2_del complete
Nov 14 11:50:11 user nova-compute[75255]: INFO nova.compute.manager [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:50:11 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:50:11 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Took 0.37 seconds to deallocate network for instance.
Nov 14 11:50:12 user nova-compute[75255]: INFO nova.compute.manager [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 11:50:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-cd953f17-c369-41b9-99a3-f57030c51968 req-6fcfd104-bdec-4daa-8f79-48936da3b177 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cd953f17-c369-41b9-99a3-f57030c51968 req-6fcfd104-bdec-4daa-8f79-48936da3b177 service nova] Acquiring lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cd953f17-c369-41b9-99a3-f57030c51968 req-6fcfd104-bdec-4daa-8f79-48936da3b177 service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-cd953f17-c369-41b9-99a3-f57030c51968 req-6fcfd104-bdec-4daa-8f79-48936da3b177 service nova] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-cd953f17-c369-41b9-99a3-f57030c51968 req-6fcfd104-bdec-4daa-8f79-48936da3b177 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] No waiting events found dispatching network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:50:12 user nova-compute[75255]: WARNING nova.compute.manager [req-cd953f17-c369-41b9-99a3-f57030c51968 req-6fcfd104-bdec-4daa-8f79-48936da3b177 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received unexpected event network-vif-plugged-a05c1b03-6fa0-46f8-860e-02cb0453f59a for instance with vm_state deleted and task_state None.
Nov 14 11:50:12 user nova-compute[75255]: DEBUG nova.compute.manager [req-cd953f17-c369-41b9-99a3-f57030c51968 req-6fcfd104-bdec-4daa-8f79-48936da3b177 service nova] [instance: c15058da-9f64-4d23-b62b-f9fdef00c4b2] Received event network-vif-deleted-a05c1b03-6fa0-46f8-860e-02cb0453f59a {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:50:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:12 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Deleted allocations for instance c15058da-9f64-4d23-b62b-f9fdef00c4b2
Nov 14 11:50:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-c95cf331-04e8-412a-aab2-ce1ede378ef2 tempest-TestVolumeBootPattern-1575864965 tempest-TestVolumeBootPattern-1575864965-project-member] Lock "c15058da-9f64-4d23-b62b-f9fdef00c4b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.568s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:50:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:50:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:50:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:50:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:50:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:50:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:50:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:50:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-changed-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG nova.compute.manager [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Refreshing instance network info cache due to event network-changed-50d1baef-accb-499c-9a2e-150c63ce7345. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] Acquiring lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] Acquired lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Refreshing network info cache for port 50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updated VIF entry in instance network info cache for port 50d1baef-accb-499c-9a2e-150c63ce7345. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG nova.network.neutron [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updating instance_info_cache with network_info: [{"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:50:56 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-f9559dcd-ac10-4826-8b11-165b59d6822f req-8f2617ca-426d-4dcd-b6d6-fec8909edc7f service nova] Releasing lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:50:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:57 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:50:57 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:50:58 user nova-compute[75255]: INFO nova.compute.manager [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Attaching volume b0f5c213-3a12-4f6c-9062-a09572e9da41 to /dev/vdb
Nov 14 11:50:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a5053c-95c9-4a7e-a2f8-acda810c8414]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00b9e9-0d31-4b93-8026-e5667bb5b9ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a7175-c20b-49c1-85cb-55b5b79a440c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f17eb0-eb75-418a-898f-08ebdaec6971]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:50:58 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:50:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f99c14-858f-4b3e-b53d-da39bfb41aff]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG os_brick.utils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:50:58 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updating existing volume attachment record: c54574c6-57b5-4d3c-985a-338221d20b1d {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:50:59 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:51:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBwSqKup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:51:02 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:51:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:51:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:51:02 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:51:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:51:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:51:02 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:51:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d2126b-937d-40e1-842e-0fe143154f3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:51:03 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa0a2ac-de07-4863-9b79-4a2e2b9f670c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41] added
Nov 14 11:51:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2494df7-346b-4647-9da8-4019e2b3957e]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d80af0-b93e-42c0-8222-e626ee6a446b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBwSqKup {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBwSqKup" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dcd57e-0a25-4654-84ee-4adba4d5f70f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBwSqKup'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fada0ca-0658-4d43-b594-12b3cd68e633]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b10894a-ee9c-4670-a01c-71a09a558641]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:51:03 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:51:03 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:51:03 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:51:03 user nova-compute[75255]: 
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e18d5-47eb-48a7-be49-c5de4bf8660b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260]
Nov 14 11:51:03 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260] successful.
Nov 14 11:51:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86cef33-ce7c-4d2d-b79f-6b7a4fb4a178]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f44d13-019d-4412-a5e4-0b117b6b714a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[12682974-132c-44d2-9ad8-4b7f54269abc]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBwSqKup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23761333962383838', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761333962383838', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG nova.objects.instance [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:51:04 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:51:04 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:51:04 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:51:04 user nova-compute[75255]:   <serial>b0f5c213-3a12-4f6c-9062-a09572e9da41</serial>
Nov 14 11:51:04 user nova-compute[75255]: </disk>
Nov 14 11:51:04 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No VIF found with MAC fa:16:3e:7c:4b:88, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:51:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-d77c1dc2-2196-495f-aefb-85e9e42d6a0e tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.737s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:51:05 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG nova.objects.instance [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:51:07 user nova-compute[75255]: INFO nova.compute.manager [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Attaching volume 6e206fe6-201a-4b8e-8f03-ce56de32ed58 to /dev/vdc
Nov 14 11:51:07 user nova-compute[75255]: DEBUG os_brick.utils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ee0407-0046-4047-a445-6dfb8ade4fdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1db9f78-f315-4b7b-b370-a9e68b4b0f2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f581fe-7735-4736-87c4-845a2f3f79e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f350885-43b9-48bb-a4b1-7084f2b79c6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:51:07 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:51:07 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e99dd37-24cf-42d6-873e-5f2c5fb31583]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG os_brick.utils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:51:07 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updating existing volume attachment record: 2b82ac77-d67d-4ce1-a348-a70e809f46bf {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:51:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75255) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:51:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:51:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.004913330078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:51:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:51:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:51:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:51:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:51:11 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:51:11 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:51:11 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:51:11 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpyHmWsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:51:12 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:51:12 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:51:12 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcd06a1-ba13-468c-8d88-8c0aec54236e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:51:12 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e316725c-e02c-485e-a817-92eebe4b7259]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58] added
Nov 14 11:51:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a241a8-d645-4ac8-8f2c-0b003221f2ad]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7877a-25ff-4657-bdcd-3d253cb9e8b8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpyHmWsN {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpyHmWsN" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9388a64d-e95c-4a65-9f3e-43c1b23ca43d]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UpyHmWsN'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee87cf1-09ce-457f-83f5-1fbfa63ce7b1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[495757ec-397e-4102-8e4d-624b87dc9291]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[26196491-3c59-4bde-a10c-433e37d5f305]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260]
Nov 14 11:51:12 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260] successful.
Nov 14 11:51:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad043a1b-c558-44f6-94b2-b13be57f82c5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c10756-419a-4eaa-b712-7e4d50f459ea]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:12 user nova-compute[75255]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)
Nov 14 11:51:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:12 user nova-compute[75255]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)
Nov 14 11:51:12 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f64db-2be7-4a40-88de-6ff424d6cabc]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:12 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpyHmWsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26361363838613932', 'path': '/dev/sdc'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361363838613932', 'path': '/dev/sdc'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG nova.objects.instance [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:51:13 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:51:13 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:51:13 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:51:13 user nova-compute[75255]:   <serial>6e206fe6-201a-4b8e-8f03-ce56de32ed58</serial>
Nov 14 11:51:13 user nova-compute[75255]: </disk>
Nov 14 11:51:13 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:51:13 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] No VIF found with MAC fa:16:3e:7c:4b:88, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:51:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-1907ccde-d0e7-48d2-b38b-3dc67d729cf0 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.543s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:51:14 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:51:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:51:15 user nova-compute[75255]: INFO nova.compute.manager [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Detaching volume b0f5c213-3a12-4f6c-9062-a09572e9da41
Nov 14 11:51:15 user nova-compute[75255]: INFO nova.virt.block_device [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Attempting to driver detach volume b0f5c213-3a12-4f6c-9062-a09572e9da41 from mountpoint /dev/vdb
Nov 14 11:51:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Attempting to detach device vdb from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:51:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:51:15 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:51:15 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:51:15 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:51:15 user nova-compute[75255]:   <serial>b0f5c213-3a12-4f6c-9062-a09572e9da41</serial>
Nov 14 11:51:15 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:51:15 user nova-compute[75255]: </disk>
Nov 14 11:51:15 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:51:15 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully detached device vdb from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the persistent domain config.
Nov 14 11:51:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:51:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:51:15 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:51:15 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:51:15 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:51:15 user nova-compute[75255]:   <serial>b0f5c213-3a12-4f6c-9062-a09572e9da41</serial>
Nov 14 11:51:15 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:51:15 user nova-compute[75255]: </disk>
Nov 14 11:51:15 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:51:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:15 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updating instance_info_cache with network_info: [{"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:51:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:51:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:35 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc is timed out.
Nov 14 11:51:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully detached device vdb from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the live domain config.
Nov 14 11:51:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBwSqKup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:51:35 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:51:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:51:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf1e7e-3fe5-4416-a44a-6ca1e61a6163]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:51:36 user nova-compute[75255]: No targets found.
Nov 14 11:51:36 user nova-compute[75255]: iSNS:
Nov 14 11:51:36 user nova-compute[75255]: No targets found.
Nov 14 11:51:36 user nova-compute[75255]: STATIC:
Nov 14 11:51:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41
Nov 14 11:51:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:51:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:51:36 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58
Nov 14 11:51:36 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:51:36 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:51:36 user nova-compute[75255]: FIRMWARE:
Nov 14 11:51:36 user nova-compute[75255]: No targets found.
Nov 14 11:51:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:51:36 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:51:36 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e424cb-118e-4eb1-9ba4-7a15a9e930d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6792b58c-6dc0-4f4a-bb97-0a4a1a37fdf6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:36 user nova-compute[75255]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)
Nov 14 11:51:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 (non-flash)
Nov 14 11:51:36 user nova-compute[75255]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)
Nov 14 11:51:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3e8831-9713-4f0e-bbea-d63904f4c992]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37943b1a-ed07-426b-bd1c-693285045f40]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f62557-144b-4cdf-b9a7-d1ef47496c81]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[453573fb-01e9-4016-a669-b075ab1ae0ee]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085584c-3aed-48db-bf28-79caee957b42]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f716bd-3ab0-4ac6-b4db-48a5e0f04f66]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260]
Nov 14 11:51:36 user nova-compute[75255]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41, portal: 172.16.0.220,3260] successful.
Nov 14 11:51:36 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0f5c213-3a12-4f6c-9062-a09572e9da41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e5ff4-78cc-42f1-88e3-925f6513a823]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== disconnect_volume: return (274ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:51:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:51:37 user nova-compute[75255]: DEBUG nova.objects.instance [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:51:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-f042b55b-a18c-4900-b5ff-5e96d6d95d33 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:51:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:51:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:51:38 user nova-compute[75255]: INFO nova.compute.manager [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Detaching volume 6e206fe6-201a-4b8e-8f03-ce56de32ed58
Nov 14 11:51:38 user nova-compute[75255]: INFO nova.virt.block_device [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Attempting to driver detach volume 6e206fe6-201a-4b8e-8f03-ce56de32ed58 from mountpoint /dev/vdc
Nov 14 11:51:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Attempting to detach device vdc from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:51:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:51:38 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:51:38 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:51:38 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:51:38 user nova-compute[75255]:   <serial>6e206fe6-201a-4b8e-8f03-ce56de32ed58</serial>
Nov 14 11:51:38 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 11:51:38 user nova-compute[75255]: </disk>
Nov 14 11:51:38 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:51:38 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully detached device vdc from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the persistent domain config.
Nov 14 11:51:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:51:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:51:38 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:51:38 user nova-compute[75255]:   <source dev="/dev/sdc"/>
Nov 14 11:51:38 user nova-compute[75255]:   <target dev="vdc" bus="virtio"/>
Nov 14 11:51:38 user nova-compute[75255]:   <serial>6e206fe6-201a-4b8e-8f03-ce56de32ed58</serial>
Nov 14 11:51:38 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 11:51:38 user nova-compute[75255]: </disk>
Nov 14 11:51:38 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:51:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:51:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:50 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:51:58 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc is timed out.
Nov 14 11:51:58 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully detached device vdc from instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc from the live domain config.
Nov 14 11:51:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpyHmWsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:51:58 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e0bb4-5ce9-45e6-9b6e-90ee9d67240e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:51:58 user nova-compute[75255]: No targets found.
Nov 14 11:51:58 user nova-compute[75255]: iSNS:
Nov 14 11:51:58 user nova-compute[75255]: No targets found.
Nov 14 11:51:58 user nova-compute[75255]: STATIC:
Nov 14 11:51:58 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58
Nov 14 11:51:58 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:51:58 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:51:58 user nova-compute[75255]: FIRMWARE:
Nov 14 11:51:58 user nova-compute[75255]: No targets found.
Nov 14 11:51:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:51:58 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:51:58 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9b305b-4092-4571-838c-2dee1293d2b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f109e795-8808-4f50-9165-63d3f4cffa44]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)
Nov 14 11:51:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 (non-flash)
Nov 14 11:51:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58'): ({'sdc'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Removing single pathed devices sdc {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[16735306-41bb-42bc-9b4f-8e3569bdb1d4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf70b9-9ebf-4303-b2e8-7be60a77301b]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Flushing IO for device /dev/sdc {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2ccd9-c5bc-43e1-91b1-8fb5b820120f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[734d8eb0-7815-4740-9454-7eb27967ccf3]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] SCSI volumes sdc have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1983c6cb-4758-4569-9ba0-efbafeb2067c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[525f7d37-b9d3-4346-8157-3e17798a64f6]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260]
Nov 14 11:51:58 user nova-compute[75255]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58, portal: 172.16.0.220,3260] successful.
Nov 14 11:51:58 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e206fe6-201a-4b8e-8f03-ce56de32ed58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b630ec4f-8d37-469b-b782-f84d9d4e6d13]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] <== disconnect_volume: return (305ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:51:58 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:51:59 user nova-compute[75255]: DEBUG nova.objects.instance [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'flavor' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:51:59 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-028869dd-3a7b-4569-ad27-8b2cb750d0fb tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:52:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:52:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:52:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:52:00 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:00 user nova-compute[75255]: INFO nova.compute.manager [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Terminating instance
Nov 14 11:52:00 user nova-compute[75255]: DEBUG nova.compute.manager [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 11:52:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-d251df77-38f3-42ed-8a11-f00a231cbbf6 req-93ad1ad0-ae47-4fd2-b154-1a80ecb01607 service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-vif-unplugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d251df77-38f3-42ed-8a11-f00a231cbbf6 req-93ad1ad0-ae47-4fd2-b154-1a80ecb01607 service nova] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d251df77-38f3-42ed-8a11-f00a231cbbf6 req-93ad1ad0-ae47-4fd2-b154-1a80ecb01607 service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-d251df77-38f3-42ed-8a11-f00a231cbbf6 req-93ad1ad0-ae47-4fd2-b154-1a80ecb01607 service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-d251df77-38f3-42ed-8a11-f00a231cbbf6 req-93ad1ad0-ae47-4fd2-b154-1a80ecb01607 service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] No waiting events found dispatching network-vif-unplugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.compute.manager [req-d251df77-38f3-42ed-8a11-f00a231cbbf6 req-93ad1ad0-ae47-4fd2-b154-1a80ecb01607 service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-vif-unplugged-50d1baef-accb-499c-9a2e-150c63ce7345 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Instance destroyed successfully.
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.objects.instance [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lazy-loading 'resources' on Instance uuid e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-512739948',display_name='tempest-AttachVolumeTestJSON-server-512739948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-512739948',id=52,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdxa1jwtLtVoIssCtwhh1EZPcT+KBCfULjtRqGyVqxCM9ImQEjz+KLlq5QCavC++kdGAO0gRyX5KCKZ/eXuKsXQIBPDQYLAJp7ewDrU5g40RuAMgCCybLYncdOeQ1tqdQ==',key_name='tempest-keypair-1122751931',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:49:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f32711b26ee74011b2733543d7c60c81',ramdisk_id='',reservation_id='r-nb0cvsv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-545907524',owner_user_name='tempest-AttachVolumeTestJSON-545907524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d508f30ed89a4451a0a383019d98dae4',uuid=e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converting VIF {"id": "50d1baef-accb-499c-9a2e-150c63ce7345", "address": "fa:16:3e:7c:4b:88", "network": {"id": "ced1bcf8-185e-4734-8ec3-cb27803b528a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1508140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f32711b26ee74011b2733543d7c60c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d1baef-ac", "ovs_interfaceid": "50d1baef-accb-499c-9a2e-150c63ce7345", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=50d1baef-accb-499c-9a2e-150c63ce7345,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d1baef-ac') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG os_vif [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=50d1baef-accb-499c-9a2e-150c63ce7345,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d1baef-ac') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50d1baef-ac, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a30a985-7325-4903-b2a1-8946437887f5) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:01 user nova-compute[75255]: INFO os_vif [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=50d1baef-accb-499c-9a2e-150c63ce7345,network=Network(ced1bcf8-185e-4734-8ec3-cb27803b528a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d1baef-ac')
Nov 14 11:52:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Deleting instance files /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc_del
Nov 14 11:52:01 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Deletion of /opt/stack/data/nova/instances/e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc_del complete
Nov 14 11:52:01 user nova-compute[75255]: INFO nova.compute.manager [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 11:52:01 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 11:52:01 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 11:52:02 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:52:02 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Took 0.78 seconds to deallocate network for instance.
Nov 14 11:52:02 user nova-compute[75255]: DEBUG nova.compute.manager [req-3aa203b7-9d67-4d99-853e-07945f17c4a2 req-cfdc592c-27e3-4de1-89bc-9607ff7f499c service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-vif-deleted-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:52:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:52:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:52:02 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:52:02 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:52:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:02 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Deleted allocations for instance e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc
Nov 14 11:52:02 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-95fab256-a807-494a-9a0d-b6862c27bff4 tempest-AttachVolumeTestJSON-545907524 tempest-AttachVolumeTestJSON-545907524-project-member] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.040s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-c318cc0e-01ed-4d89-8f1a-b3437df8710d req-391fff2c-2483-4eae-a496-18831d5a8b3a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received event network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:52:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c318cc0e-01ed-4d89-8f1a-b3437df8710d req-391fff2c-2483-4eae-a496-18831d5a8b3a service nova] Acquiring lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:52:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c318cc0e-01ed-4d89-8f1a-b3437df8710d req-391fff2c-2483-4eae-a496-18831d5a8b3a service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:52:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c318cc0e-01ed-4d89-8f1a-b3437df8710d req-391fff2c-2483-4eae-a496-18831d5a8b3a service nova] Lock "e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:03 user nova-compute[75255]: DEBUG nova.compute.manager [req-c318cc0e-01ed-4d89-8f1a-b3437df8710d req-391fff2c-2483-4eae-a496-18831d5a8b3a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] No waiting events found dispatching network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:52:03 user nova-compute[75255]: WARNING nova.compute.manager [req-c318cc0e-01ed-4d89-8f1a-b3437df8710d req-391fff2c-2483-4eae-a496-18831d5a8b3a service nova] [instance: e7935d96-e2d2-4ff1-a49c-0d1559c1e0fc] Received unexpected event network-vif-plugged-50d1baef-accb-499c-9a2e-150c63ce7345 for instance with vm_state deleted and task_state None.
Nov 14 11:52:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:52:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:52:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:52:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9183MB free_disk=25.022857666015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:52:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:52:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:52:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:17 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:52:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:52:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:52:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:52:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:52:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:52:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:52:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:52:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:52:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:00 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:53:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:53:10 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9194MB free_disk=25.021286010742188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:53:10 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:53:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:13 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:53:16 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:17 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:53:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:53:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:53:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_power_states {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:53:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:53:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:53:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:37 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:53:38 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:53:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:53:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:53:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:53:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:53:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:53:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:53:41 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:51 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:53:56 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:01 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:54:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:05 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:06 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:07 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:11 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:54:12 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:54:12 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:54:12 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9209MB free_disk=25.02288818359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:54:12 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:14 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:54:16 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:54:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:54:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:54:20 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 11:54:20 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:21 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:25 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:26 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:29 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:31 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Starting instance... {{(pid=75255) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75255) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 11:54:35 user nova-compute[75255]: INFO nova.compute.claims [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Claim successful on node user
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Start building networks asynchronously for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Allocating IP information in the background. {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.network.neutron [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] allocate_for_instance() {{(pid=75255) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 11:54:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Start building block device mappings for instance. {{(pid=75255) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Start spawning the instance on the hypervisor. {{(pid=75255) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Creating instance directory {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 11:54:35 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Creating image(s)
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "/opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "/opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "/opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG nova.policy [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9df537a1822e49f8a6f788765df6314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19771090150b4496b75a00500243dfeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75255) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.200s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.180s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk 1073741824 {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96,backing_fmt=raw /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk 1073741824" returned: 0 in 0.060s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "fa86f4c53d6d25d0f34f4cef49c112a31300ff96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa86f4c53d6d25d0f34f4cef49c112a31300ff96 --force-share --output=json" returned: 0 in 0.218s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk. size=1073741824 {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG nova.network.neutron [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Successfully created port: dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG nova.virt.disk.api [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Cannot resize image /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk to a smaller size. {{(pid=75255) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Created local disks {{(pid=75255) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Ensure instance console log exists: /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/console.log {{(pid=75255) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:36 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Successfully updated port: dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Building network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Instance cache missing network info. {{(pid=75255) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-changed-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.compute.manager [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Refreshing instance network info cache due to event network-changed-dd7247d0-ae90-4eee-ae60-41779b8457e1. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.network.neutron [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Instance network_info: |[{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75255) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.network.neutron [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Refreshing network info cache for port dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:54:37 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Start _get_guest_xml network_info=[{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '26cc9ab5-432f-4182-801c-11cab6c13c7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 11:54:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:54:38 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CPU controller missing on host. {{(pid=75255) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.host [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CPU controller found on host. {{(pid=75255) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75255) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T11:02:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T11:02:47Z,direct_url=<?>,disk_format='qcow2',id=26cc9ab5-432f-4182-801c-11cab6c13c7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de9682d5d8634919aa7c4974ac5bbe79',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T11:02:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Flavor limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Image limits 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Flavor pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Image pref 0:0:0 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Got 1 possible topologies {{(pid=75255) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.hardware [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75255) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:54:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-291472576',display_name='tempest-SnapshotDataIntegrityTests-server-291472576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-291472576',id=53,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXqez8zdG7ufJgHLG+GKDJn8RymthRwETHMp7S2IRH46yis+FKNLWz/QOyOtbGPIqiKGgq65tmydI2VUlPTyyJFX+EYzhlcsG9wdO25m92rtAZ5kTJn2wtQlcaLR0hBbw==',key_name='tempest-keypair-1879102579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19771090150b4496b75a00500243dfeb',ramdisk_id='',reservation_id='r-bxj54rq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1019157252',owner_user_name='tempest-SnapshotDataIntegrityTests-1019157252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df537a1822e49f8a6f788765df6314b',uuid=4af3fbd1-da3c-4f3a-aecd-f497a200ea89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75255) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Converting VIF {"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8d:b0,bridge_name='br-int',has_traffic_filtering=True,id=dd7247d0-ae90-4eee-ae60-41779b8457e1,network=Network(7d77225a-f626-4acf-a055-3afaa8d1aae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7247d0-ae') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.objects.instance [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'pci_devices' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] End _get_guest_xml xml=<domain type="kvm">
Nov 14 11:54:38 user nova-compute[75255]:   <uuid>4af3fbd1-da3c-4f3a-aecd-f497a200ea89</uuid>
Nov 14 11:54:38 user nova-compute[75255]:   <name>instance-00000035</name>
Nov 14 11:54:38 user nova-compute[75255]:   <memory>524288</memory>
Nov 14 11:54:38 user nova-compute[75255]:   <vcpu>1</vcpu>
Nov 14 11:54:38 user nova-compute[75255]:   <metadata>
Nov 14 11:54:38 user nova-compute[75255]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 11:54:38 user nova-compute[75255]:       <nova:package version="0.0.0"/>
Nov 14 11:54:38 user nova-compute[75255]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-291472576</nova:name>
Nov 14 11:54:38 user nova-compute[75255]:       <nova:creationTime>2023-11-14 11:54:38</nova:creationTime>
Nov 14 11:54:38 user nova-compute[75255]:       <nova:flavor name="m1.tiny">
Nov 14 11:54:38 user nova-compute[75255]:         <nova:memory>512</nova:memory>
Nov 14 11:54:38 user nova-compute[75255]:         <nova:disk>1</nova:disk>
Nov 14 11:54:38 user nova-compute[75255]:         <nova:swap>0</nova:swap>
Nov 14 11:54:38 user nova-compute[75255]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 11:54:38 user nova-compute[75255]:         <nova:vcpus>1</nova:vcpus>
Nov 14 11:54:38 user nova-compute[75255]:       </nova:flavor>
Nov 14 11:54:38 user nova-compute[75255]:       <nova:owner>
Nov 14 11:54:38 user nova-compute[75255]:         <nova:user uuid="9df537a1822e49f8a6f788765df6314b">tempest-SnapshotDataIntegrityTests-1019157252-project-member</nova:user>
Nov 14 11:54:38 user nova-compute[75255]:         <nova:project uuid="19771090150b4496b75a00500243dfeb">tempest-SnapshotDataIntegrityTests-1019157252</nova:project>
Nov 14 11:54:38 user nova-compute[75255]:       </nova:owner>
Nov 14 11:54:38 user nova-compute[75255]:       <nova:root type="image" uuid="26cc9ab5-432f-4182-801c-11cab6c13c7e"/>
Nov 14 11:54:38 user nova-compute[75255]:       <nova:ports>
Nov 14 11:54:38 user nova-compute[75255]:         <nova:port uuid="dd7247d0-ae90-4eee-ae60-41779b8457e1">
Nov 14 11:54:38 user nova-compute[75255]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 11:54:38 user nova-compute[75255]:         </nova:port>
Nov 14 11:54:38 user nova-compute[75255]:       </nova:ports>
Nov 14 11:54:38 user nova-compute[75255]:     </nova:instance>
Nov 14 11:54:38 user nova-compute[75255]:   </metadata>
Nov 14 11:54:38 user nova-compute[75255]:   <sysinfo type="smbios">
Nov 14 11:54:38 user nova-compute[75255]:     <system>
Nov 14 11:54:38 user nova-compute[75255]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 11:54:38 user nova-compute[75255]:       <entry name="product">OpenStack Nova</entry>
Nov 14 11:54:38 user nova-compute[75255]:       <entry name="version">0.0.0</entry>
Nov 14 11:54:38 user nova-compute[75255]:       <entry name="serial">4af3fbd1-da3c-4f3a-aecd-f497a200ea89</entry>
Nov 14 11:54:38 user nova-compute[75255]:       <entry name="uuid">4af3fbd1-da3c-4f3a-aecd-f497a200ea89</entry>
Nov 14 11:54:38 user nova-compute[75255]:       <entry name="family">Virtual Machine</entry>
Nov 14 11:54:38 user nova-compute[75255]:     </system>
Nov 14 11:54:38 user nova-compute[75255]:   </sysinfo>
Nov 14 11:54:38 user nova-compute[75255]:   <os>
Nov 14 11:54:38 user nova-compute[75255]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 11:54:38 user nova-compute[75255]:     <boot dev="hd"/>
Nov 14 11:54:38 user nova-compute[75255]:     <smbios mode="sysinfo"/>
Nov 14 11:54:38 user nova-compute[75255]:   </os>
Nov 14 11:54:38 user nova-compute[75255]:   <features>
Nov 14 11:54:38 user nova-compute[75255]:     <acpi/>
Nov 14 11:54:38 user nova-compute[75255]:     <apic/>
Nov 14 11:54:38 user nova-compute[75255]:     <vmcoreinfo/>
Nov 14 11:54:38 user nova-compute[75255]:   </features>
Nov 14 11:54:38 user nova-compute[75255]:   <clock offset="utc">
Nov 14 11:54:38 user nova-compute[75255]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 11:54:38 user nova-compute[75255]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 11:54:38 user nova-compute[75255]:     <timer name="hpet" present="no"/>
Nov 14 11:54:38 user nova-compute[75255]:   </clock>
Nov 14 11:54:38 user nova-compute[75255]:   <cpu mode="custom" match="exact">
Nov 14 11:54:38 user nova-compute[75255]:     <model>Nehalem</model>
Nov 14 11:54:38 user nova-compute[75255]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 11:54:38 user nova-compute[75255]:   </cpu>
Nov 14 11:54:38 user nova-compute[75255]:   <devices>
Nov 14 11:54:38 user nova-compute[75255]:     <disk type="file" device="disk">
Nov 14 11:54:38 user nova-compute[75255]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 11:54:38 user nova-compute[75255]:       <source file="/opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk"/>
Nov 14 11:54:38 user nova-compute[75255]:       <target dev="vda" bus="virtio"/>
Nov 14 11:54:38 user nova-compute[75255]:     </disk>
Nov 14 11:54:38 user nova-compute[75255]:     <interface type="ethernet">
Nov 14 11:54:38 user nova-compute[75255]:       <mac address="fa:16:3e:6c:8d:b0"/>
Nov 14 11:54:38 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:54:38 user nova-compute[75255]:       <mtu size="1442"/>
Nov 14 11:54:38 user nova-compute[75255]:       <target dev="tapdd7247d0-ae"/>
Nov 14 11:54:38 user nova-compute[75255]:     </interface>
Nov 14 11:54:38 user nova-compute[75255]:     <serial type="pty">
Nov 14 11:54:38 user nova-compute[75255]:       <log file="/opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/console.log" append="off"/>
Nov 14 11:54:38 user nova-compute[75255]:     </serial>
Nov 14 11:54:38 user nova-compute[75255]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 11:54:38 user nova-compute[75255]:     <video>
Nov 14 11:54:38 user nova-compute[75255]:       <model type="virtio"/>
Nov 14 11:54:38 user nova-compute[75255]:     </video>
Nov 14 11:54:38 user nova-compute[75255]:     <rng model="virtio">
Nov 14 11:54:38 user nova-compute[75255]:       <backend model="random">/dev/urandom</backend>
Nov 14 11:54:38 user nova-compute[75255]:     </rng>
Nov 14 11:54:38 user nova-compute[75255]:     <controller type="usb" index="0" model="none"/>
Nov 14 11:54:38 user nova-compute[75255]:     <memballoon model="virtio">
Nov 14 11:54:38 user nova-compute[75255]:       <stats period="10"/>
Nov 14 11:54:38 user nova-compute[75255]:     </memballoon>
Nov 14 11:54:38 user nova-compute[75255]:   </devices>
Nov 14 11:54:38 user nova-compute[75255]: </domain>
Nov 14 11:54:38 user nova-compute[75255]:  {{(pid=75255) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:54:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-291472576',display_name='tempest-SnapshotDataIntegrityTests-server-291472576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-291472576',id=53,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXqez8zdG7ufJgHLG+GKDJn8RymthRwETHMp7S2IRH46yis+FKNLWz/QOyOtbGPIqiKGgq65tmydI2VUlPTyyJFX+EYzhlcsG9wdO25m92rtAZ5kTJn2wtQlcaLR0hBbw==',key_name='tempest-keypair-1879102579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19771090150b4496b75a00500243dfeb',ramdisk_id='',reservation_id='r-bxj54rq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1019157252',owner_user_name='tempest-SnapshotDataIntegrityTests-1019157252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T11:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df537a1822e49f8a6f788765df6314b',uuid=4af3fbd1-da3c-4f3a-aecd-f497a200ea89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Converting VIF {"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8d:b0,bridge_name='br-int',has_traffic_filtering=True,id=dd7247d0-ae90-4eee-ae60-41779b8457e1,network=Network(7d77225a-f626-4acf-a055-3afaa8d1aae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7247d0-ae') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG os_vif [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8d:b0,bridge_name='br-int',has_traffic_filtering=True,id=dd7247d0-ae90-4eee-ae60-41779b8457e1,network=Network(7d77225a-f626-4acf-a055-3afaa8d1aae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7247d0-ae') {{(pid=75255) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '528c4332-ba84-5f55-8f00-a2c164d82ee3', '_type': 'linux-noop'}}, row=False) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd7247d0-ae, may_exist=True, interface_attrs={}) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd7247d0-ae, col_values=(('qos', UUID('6e458627-4f1b-4025-819b-987a3cd05077')),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd7247d0-ae, col_values=(('external_ids', {'iface-id': 'dd7247d0-ae90-4eee-ae60-41779b8457e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:8d:b0', 'vm-uuid': '4af3fbd1-da3c-4f3a-aecd-f497a200ea89'}),), if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:38 user nova-compute[75255]: INFO os_vif [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8d:b0,bridge_name='br-int',has_traffic_filtering=True,id=dd7247d0-ae90-4eee-ae60-41779b8457e1,network=Network(7d77225a-f626-4acf-a055-3afaa8d1aae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7247d0-ae')
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No VIF found with MAC fa:16:3e:6c:8d:b0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.network.neutron [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated VIF entry in instance network info cache for port dd7247d0-ae90-4eee-ae60-41779b8457e1. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG nova.network.neutron [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:54:38 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-5b397250-0dbc-496f-a547-a7cb50bf1258 req-7026a4ef-c225-49d8-a40d-9b3149b58d90 service nova] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:54:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:39 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-0493e969-365c-4773-88f4-46cd8be14e89 req-a035d514-2211-4283-875a-6743b931e1ad service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:54:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0493e969-365c-4773-88f4-46cd8be14e89 req-a035d514-2211-4283-875a-6743b931e1ad service nova] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0493e969-365c-4773-88f4-46cd8be14e89 req-a035d514-2211-4283-875a-6743b931e1ad service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:39 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0493e969-365c-4773-88f4-46cd8be14e89 req-a035d514-2211-4283-875a-6743b931e1ad service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:39 user nova-compute[75255]: DEBUG nova.compute.manager [req-0493e969-365c-4773-88f4-46cd8be14e89 req-a035d514-2211-4283-875a-6743b931e1ad service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] No waiting events found dispatching network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:54:39 user nova-compute[75255]: WARNING nova.compute.manager [req-0493e969-365c-4773-88f4-46cd8be14e89 req-a035d514-2211-4283-875a-6743b931e1ad service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received unexpected event network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 for instance with vm_state building and task_state spawning.
Nov 14 11:54:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Instance event wait completed in 0 seconds for  {{(pid=75255) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Guest created on hypervisor {{(pid=75255) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 11:54:41 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Instance spawned successfully.
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Found default for hw_cdrom_bus of ide {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Found default for hw_disk_bus of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Found default for hw_input_bus of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Found default for hw_pointer_model of None {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Found default for hw_video_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Found default for hw_vif_model of virtio {{(pid=75255) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-1d8c5396-a7d8-482b-b2da-ea20dede8e06 req-2490324e-8851-407b-afcf-8a93e45b6e9d service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1d8c5396-a7d8-482b-b2da-ea20dede8e06 req-2490324e-8851-407b-afcf-8a93e45b6e9d service nova] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1d8c5396-a7d8-482b-b2da-ea20dede8e06 req-2490324e-8851-407b-afcf-8a93e45b6e9d service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-1d8c5396-a7d8-482b-b2da-ea20dede8e06 req-2490324e-8851-407b-afcf-8a93e45b6e9d service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.compute.manager [req-1d8c5396-a7d8-482b-b2da-ea20dede8e06 req-2490324e-8851-407b-afcf-8a93e45b6e9d service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] No waiting events found dispatching network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 11:54:41 user nova-compute[75255]: WARNING nova.compute.manager [req-1d8c5396-a7d8-482b-b2da-ea20dede8e06 req-2490324e-8851-407b-afcf-8a93e45b6e9d service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received unexpected event network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 for instance with vm_state building and task_state spawning.
Nov 14 11:54:41 user nova-compute[75255]: INFO nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 14 11:54:41 user nova-compute[75255]: DEBUG nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Checking state {{(pid=75255) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 11:54:41 user nova-compute[75255]: INFO nova.compute.manager [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Took 6.78 seconds to build instance.
Nov 14 11:54:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-990cde5c-ab41-438f-817a-c557f19a9ad2 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.909s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:54:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:54:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:54:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:54:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:54:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:55 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:54:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:02 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:05 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:07 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:09 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:10 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:55:13 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:55:13 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:55:13 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=24.97537612915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:55:13 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:55:14 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:55:14 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:55:14 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:55:14 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:55:14 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:55:14 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:55:14 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:55:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:15 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:55:15 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:55:22 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:55:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:55:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:55:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:55:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:55:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:55:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:55:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:55:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:55:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:03 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:05 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:56:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:56:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:14 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:15 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:56:15 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=24.974594116210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:56:15 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:56:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:56:23 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-changed-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG nova.compute.manager [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Refreshing instance network info cache due to event network-changed-dd7247d0-ae90-4eee-ae60-41779b8457e1. {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Refreshing network info cache for port dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated VIF entry in instance network info cache for port dd7247d0-ae90-4eee-ae60-41779b8457e1. {{(pid=75255) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG nova.network.neutron [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:56:26 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-c17dcece-b8d6-44c6-acdf-08a31a0f479c req-f882079e-db07-448b-8a65-abaf4d55a887 service nova] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:56:28 user nova-compute[75255]: INFO nova.compute.manager [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attaching volume 3a50182c-d777-492c-9665-0288f41f62fd to /dev/vdb
Nov 14 11:56:28 user nova-compute[75255]: DEBUG os_brick.utils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4365d0ad-c635-4e1f-96ad-887638ee8720]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafbd482-01d4-4705-a056-8b1670113e47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6215f7a-d2df-4be9-9625-3be67faeb472]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4248408-d33b-4236-a183-c93faf2390df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:56:28 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:56:28 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[296639d4-188d-4dc0-8596-5d228bdc9083]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG os_brick.utils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:56:28 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating existing volume attachment record: 12416298-9113-4da8-a7eb-6072ccb02f04 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:56:30 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:32 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:56:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wcYgDvmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:56:32 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:56:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:56:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:56:32 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:56:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:56:32 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:56:33 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825f17b-942b-4ad4-b409-c49c6336484a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:56:33 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5fb8ca-a788-4d98-9ca9-5f57cb38d196]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd] added
Nov 14 11:56:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5c7ab1-fe57-41d1-9411-cf19de9c2610]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abff2fb-b2bd-4628-951a-ca81eaa2ee75]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wcYgDvmF {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wcYgDvmF" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e71c521-4ac9-4490-84af-23dcdbe2bf02]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wcYgDvmF'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5868e-4878-4367-8362-d2c90165c0d5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2e7a9-a4ae-4a65-88cd-69c1ea27b239]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:56:33 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:56:33 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:56:33 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:56:33 user nova-compute[75255]: 
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5761e45-360a-450b-8fa8-a076f949dbb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260]
Nov 14 11:56:33 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260] successful.
Nov 14 11:56:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de93b5a-0bd7-40d3-85c8-d10df2d5cde6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[366750b2-ac39-4c9f-9ffd-b4511bc26197]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd (non-flash)
Nov 14 11:56:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd (non-flash)
Nov 14 11:56:33 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e481c4-e62e-469e-ba80-fe3776e6cc7e]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:56:33 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wcYgDvmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26661396631396430', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661396631396430', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:56:34 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:56:34 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:56:34 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:56:34 user nova-compute[75255]:   <serial>3a50182c-d777-492c-9665-0288f41f62fd</serial>
Nov 14 11:56:34 user nova-compute[75255]: </disk>
Nov 14 11:56:34 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No VIF found with MAC fa:16:3e:6c:8d:b0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:56:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-7a650e56-dc16-4b73-80df-0dc07be2ab61 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.122s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:56:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:56:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:56:41 user nova-compute[75255]: INFO nova.compute.manager [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Detaching volume 3a50182c-d777-492c-9665-0288f41f62fd
Nov 14 11:56:42 user nova-compute[75255]: INFO nova.virt.block_device [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attempting to driver detach volume 3a50182c-d777-492c-9665-0288f41f62fd from mountpoint /dev/vdb
Nov 14 11:56:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Attempting to detach device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:56:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:56:42 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:56:42 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:56:42 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:56:42 user nova-compute[75255]:   <serial>3a50182c-d777-492c-9665-0288f41f62fd</serial>
Nov 14 11:56:42 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:56:42 user nova-compute[75255]: </disk>
Nov 14 11:56:42 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:56:42 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config.
Nov 14 11:56:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:56:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:56:42 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:56:42 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:56:42 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:56:42 user nova-compute[75255]:   <serial>3a50182c-d777-492c-9665-0288f41f62fd</serial>
Nov 14 11:56:42 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:56:42 user nova-compute[75255]: </disk>
Nov 14 11:56:42 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:56:42 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:56:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:56:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:00 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:02 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 is timed out.
Nov 14 11:57:02 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config.
Nov 14 11:57:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wcYgDvmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:57:02 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca756702-8fe7-427f-8aeb-e905abb14c9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:57:02 user nova-compute[75255]: No targets found.
Nov 14 11:57:02 user nova-compute[75255]: iSNS:
Nov 14 11:57:02 user nova-compute[75255]: No targets found.
Nov 14 11:57:02 user nova-compute[75255]: STATIC:
Nov 14 11:57:02 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd
Nov 14 11:57:02 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:57:02 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:57:02 user nova-compute[75255]: FIRMWARE:
Nov 14 11:57:02 user nova-compute[75255]: No targets found.
Nov 14 11:57:02 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:57:02 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:57:02 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc455b8-f307-4eef-b450-ec5559fce59c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce55476-d081-44c6-b794-99179bf73dbc]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd (non-flash)
Nov 14 11:57:02 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd (non-flash)
Nov 14 11:57:02 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32819d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f86482-6c46-4fad-a534-4eec3e434231]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0bd7d9-0468-4b09-8655-66fd53949b57]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f855ea-70f6-430a-acfd-b3d91b168f19]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8846a53d-7a92-4fe4-8a02-05ef20b08604]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13cc52-42c0-45ab-ade9-995b5d5c995f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9494e889-d236-4383-98fe-220c3cdbb17b]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260]
Nov 14 11:57:02 user nova-compute[75255]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd, portal: 172.16.0.220,3260] successful.
Nov 14 11:57:02 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a50182c-d777-492c-9665-0288f41f62fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf2ea38-6b97-4648-b656-271adf2662f3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== disconnect_volume: return (335ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:57:02 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:57:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:03 user nova-compute[75255]: DEBUG nova.objects.instance [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:57:03 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-ff656623-d5f6-4ea0-9fbf-9e29c0e26349 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:57:04 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:06 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:57:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:11 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:57:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:14 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:14 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:57:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:17 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:57:17 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=24.97325897216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:57:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:57:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:57:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:57:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:57:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:57:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:57:33 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:57:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:57:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:57:35 user nova-compute[75255]: INFO nova.compute.manager [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attaching volume d1843b2b-7f0d-42d1-a007-d0210d9342d1 to /dev/vdb
Nov 14 11:57:35 user nova-compute[75255]: DEBUG os_brick.utils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3fc80e-c6dd-4339-a87b-069be1524491]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[14949b35-6098-4c0e-9f4f-e08bb9d53b4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe780d5-7d71-40dd-95ec-c4653fbc1ad3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3c0ed-4334-4bf7-ab46-b39846d2fdf8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:57:35 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:57:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8509709c-0b9b-4ba5-bcbb-21fd9230ab1f]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG os_brick.utils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating existing volume attachment record: 73e7aca3-2593-4395-984e-3aa182ecf91a {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:57:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDJEdMnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:57:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:57:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:57:39 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f0f84f-e3b9-4517-8529-9d73f75416bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:57:39 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[70515faa-df57-4e32-b8f5-fdbab4c42327]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1] added
Nov 14 11:57:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6383ba-f959-43b2-8aaf-33ba63f817f5]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b2773-3fc7-4899-9423-5e3c491d4f4f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDJEdMnU {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDJEdMnU" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee17696d-1da8-4920-b7e4-f8ae6ad7d376]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RDJEdMnU'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d716098a-87f6-46fb-9384-f1800d0dff45]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71a79f0-0ed9-43ce-9dd1-8fd167d1c0b9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:57:39 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:57:39 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:57:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:57:39 user nova-compute[75255]: 
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b31af74-1637-494a-8bd9-5aaa713168c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260]
Nov 14 11:57:39 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260] successful.
Nov 14 11:57:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.066s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e369ffeb-f949-4d93-9a7c-0e444c484ed8]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30ba3f-e7b3-425c-86d3-d33f56d14ef2]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 (non-flash)
Nov 14 11:57:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 (non-flash)
Nov 14 11:57:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffbc9da-89bb-429c-bf1c-23f015314770]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:57:39 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:57:40 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:57:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDJEdMnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:57:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:57:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23430386632666261', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:57:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430386632666261', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:57:40 user nova-compute[75255]: DEBUG nova.objects.instance [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:57:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:57:40 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:57:40 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:57:40 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:57:40 user nova-compute[75255]:   <serial>d1843b2b-7f0d-42d1-a007-d0210d9342d1</serial>
Nov 14 11:57:40 user nova-compute[75255]: </disk>
Nov 14 11:57:40 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:57:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:57:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:57:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No VIF found with MAC fa:16:3e:6c:8d:b0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:57:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-64f7eef3-8b49-400c-9137-d543c1adf85e tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.208s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:57:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:57:42 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:57:42 user nova-compute[75255]: INFO nova.compute.manager [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Detaching volume d1843b2b-7f0d-42d1-a007-d0210d9342d1
Nov 14 11:57:43 user nova-compute[75255]: INFO nova.virt.block_device [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attempting to driver detach volume d1843b2b-7f0d-42d1-a007-d0210d9342d1 from mountpoint /dev/vdb
Nov 14 11:57:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Attempting to detach device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:57:43 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:57:43 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:57:43 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:57:43 user nova-compute[75255]:   <serial>d1843b2b-7f0d-42d1-a007-d0210d9342d1</serial>
Nov 14 11:57:43 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:57:43 user nova-compute[75255]: </disk>
Nov 14 11:57:43 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:57:43 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config.
Nov 14 11:57:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:57:43 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:57:43 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:57:43 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:57:43 user nova-compute[75255]:   <serial>d1843b2b-7f0d-42d1-a007-d0210d9342d1</serial>
Nov 14 11:57:43 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:57:43 user nova-compute[75255]: </disk>
Nov 14 11:57:43 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:57:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:57:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:57:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:57:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:57:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:03 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 is timed out.
Nov 14 11:58:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config.
Nov 14 11:58:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDJEdMnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:58:03 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d4eac6-fb5a-488c-93bb-25afcb18781f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:58:03 user nova-compute[75255]: No targets found.
Nov 14 11:58:03 user nova-compute[75255]: iSNS:
Nov 14 11:58:03 user nova-compute[75255]: No targets found.
Nov 14 11:58:03 user nova-compute[75255]: STATIC:
Nov 14 11:58:03 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1
Nov 14 11:58:03 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:58:03 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:58:03 user nova-compute[75255]: FIRMWARE:
Nov 14 11:58:03 user nova-compute[75255]: No targets found.
Nov 14 11:58:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:58:03 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:58:03 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d2ff1-6a3b-41e5-a39f-4b531cb7b39b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f52196-95b8-49f9-bbf1-a5dd907b155f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 (non-flash)
Nov 14 11:58:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 (non-flash)
Nov 14 11:58:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086c2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[272975e1-5c59-449f-8e67-75eab986df9a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8418edb-3262-4024-948e-ab3e947e0047]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[af774cf1-0892-42c4-bd9f-69d4afea610b]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7b265-6d8e-4147-b39e-d32eaa67f999]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5987e0-d848-4a34-aade-2c9bf13a5a3f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55f5fd6-a929-40b2-99f9-ebc65dd5b9a5]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260]
Nov 14 11:58:03 user nova-compute[75255]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1, portal: 172.16.0.220,3260] successful.
Nov 14 11:58:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1843b2b-7f0d-42d1-a007-d0210d9342d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9755f-75fa-4311-affe-11c914f5c6e2]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== disconnect_volume: return (289ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:58:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:58:04 user nova-compute[75255]: DEBUG nova.objects.instance [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:58:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-88535dda-d329-4a02-89af-c68fbe0ce9df tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.607s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:58:05 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:07 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:58:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:11 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:58:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:16 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:16 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:16 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:17 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:58:17 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:58:17 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=24.97235107421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:58:17 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing inventories for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating ProviderTree inventory for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Updating inventory in ProviderTree for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing aggregate associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, aggregates: None {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Refreshing trait associations for resource provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS {{(pid=75255) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:58:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:23 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:58:24 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:58:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:58:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:58:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:58:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:58:34 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:58:34 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:58:35 user nova-compute[75255]: INFO nova.compute.manager [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attaching volume edb24eba-ec91-42b8-a673-ec5df07c6ab2 to /dev/vdb
Nov 14 11:58:35 user nova-compute[75255]: DEBUG os_brick.utils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1c3759-2b6e-4a29-92ea-fb0768d42a93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dcbbe1-1ba5-40fa-b947-63c2a2c796fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bf8003-d100-4b1b-9b01-cbbef6b58c9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5244334-0ce9-4607-acf3-f6370630d2a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:58:35 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:58:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a486f-7bec-4348-be93-2a8cf829fb8f]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG os_brick.utils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating existing volume attachment record: 4b5151ad-d426-4358-8a07-a1ca0aba3025 {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:58:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] There are 0 instances to clean {{(pid=75255) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdHBfowP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:58:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:58:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:58:39 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[311749e0-9b2a-46dd-b98d-9ad424d16237]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:58:39 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac584ee-1e02-4735-8387-8c4696963a8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2] added
Nov 14 11:58:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd81447-e258-4131-b2b8-df9885a5e157]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8772e41e-8afd-43bc-ae20-efbc6e791ed1]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdHBfowP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdHBfowP" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d764b-6299-4062-a02a-7c754e6f2975]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdHBfowP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc08dcba-fd61-4138-b44d-3350daef992c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d249623-dd11-4da2-91de-46af6756b06b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:58:39 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:58:39 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:58:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:58:39 user nova-compute[75255]: 
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2d300-1ab6-4c42-aef8-ab8090ef6af6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260]
Nov 14 11:58:39 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260] successful.
Nov 14 11:58:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df433d-c34a-446a-8fbc-28017ca2f0a6]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2fe636-c587-4a8b-969b-71cd1bdfc728]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 (non-flash)
Nov 14 11:58:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 (non-flash)
Nov 14 11:58:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[67001ec0-a265-464d-be8c-557533d37620]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:58:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdHBfowP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23864353262626437', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864353262626437', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG nova.objects.instance [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:58:40 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:58:40 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:58:40 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:58:40 user nova-compute[75255]:   <serial>edb24eba-ec91-42b8-a673-ec5df07c6ab2</serial>
Nov 14 11:58:40 user nova-compute[75255]: </disk>
Nov 14 11:58:40 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:58:40 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No VIF found with MAC fa:16:3e:6c:8d:b0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:58:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-e4cccd9c-a0ed-47d8-ba77-7061d6914552 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.017s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:58:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:58:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:58:43 user nova-compute[75255]: INFO nova.compute.manager [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Detaching volume edb24eba-ec91-42b8-a673-ec5df07c6ab2
Nov 14 11:58:43 user nova-compute[75255]: INFO nova.virt.block_device [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attempting to driver detach volume edb24eba-ec91-42b8-a673-ec5df07c6ab2 from mountpoint /dev/vdb
Nov 14 11:58:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Attempting to detach device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:58:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:58:43 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:58:43 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:58:43 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:58:43 user nova-compute[75255]:   <serial>edb24eba-ec91-42b8-a673-ec5df07c6ab2</serial>
Nov 14 11:58:43 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:58:43 user nova-compute[75255]: </disk>
Nov 14 11:58:43 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:58:43 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config.
Nov 14 11:58:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:58:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:58:43 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:58:43 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:58:43 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:58:43 user nova-compute[75255]:   <serial>edb24eba-ec91-42b8-a673-ec5df07c6ab2</serial>
Nov 14 11:58:43 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:58:43 user nova-compute[75255]: </disk>
Nov 14 11:58:43 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:58:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:58:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:48 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:48 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Cleaning up deleted instances with incomplete migration  {{(pid=75255) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 11:58:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:50 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:58:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:58:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:58:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:58:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:58:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:03 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 is timed out.
Nov 14 11:59:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config.
Nov 14 11:59:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdHBfowP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:59:03 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ed7bb2-5d93-4ab9-bd80-95f24d35e3f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 11:59:03 user nova-compute[75255]: No targets found.
Nov 14 11:59:03 user nova-compute[75255]: iSNS:
Nov 14 11:59:03 user nova-compute[75255]: No targets found.
Nov 14 11:59:03 user nova-compute[75255]: STATIC:
Nov 14 11:59:03 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2
Nov 14 11:59:03 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 11:59:03 user nova-compute[75255]:                 Iface Name: default
Nov 14 11:59:03 user nova-compute[75255]: FIRMWARE:
Nov 14 11:59:03 user nova-compute[75255]: No targets found.
Nov 14 11:59:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 11:59:03 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 11:59:03 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f610fb-d3b3-4dd7-980e-f320087c9cc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f4a971-85a2-4cbb-965a-5d48eaec9a1f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 (non-flash)
Nov 14 11:59:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 (non-flash)
Nov 14 11:59:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3086c2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae98d6e-f84b-4af8-8887-aa15fb7265c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53383ee-405c-4833-be67-974007999460]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b6467a-1a43-4e74-9116-f4953c6a3353]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[722be1ef-d88c-40f9-9887-5e230252c56c]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210b3eb-5a21-4c2a-80f8-884748707c3f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dffbde-a1e7-4221-8480-bd2f7fa548b2]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260]
Nov 14 11:59:03 user nova-compute[75255]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2, portal: 172.16.0.220,3260] successful.
Nov 14 11:59:03 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb24eba-ec91-42b8-a673-ec5df07c6ab2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b03878-64c0-4d7d-9de1-fb606532b418]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== disconnect_volume: return (319ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:59:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 11:59:04 user nova-compute[75255]: DEBUG nova.objects.instance [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:59:04 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-6304fa2c-e1c4-4e92-8e88-ac4499c9fcac tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:59:07 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:59:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:12 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:59:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:16 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:17 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 11:59:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:59:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:19 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:59:19 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 11:59:19 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=24.971351623535156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 11:59:19 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 11:59:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 11:59:20 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 11:59:20 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 11:59:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 11:59:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:59:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:59:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:24 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 11:59:25 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 11:59:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:59:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 11:59:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 11:59:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 11:59:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG nova.objects.instance [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:59:35 user nova-compute[75255]: INFO nova.compute.manager [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attaching volume bf70a403-a77c-44a8-a50f-78d4b26427d9 to /dev/vdb
Nov 14 11:59:35 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG os_brick.utils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d966075b-01cf-45df-848e-f2804213f486]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2c7a26138469\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9149e5cd-b019-45ab-b70c-260f916849d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de92da3-6cab-4ce4-8afd-db767aa90540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3de2af-f8fa-4a9a-8012-b127d563945d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Running cmd (subprocess): nvme version {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.nvmeof [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] nvme not present on system {{(pid=75255) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 11:59:35 user nova-compute[75255]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 11:59:35 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdbbf96-b7ae-4487-ba23-f9881af5c70a]: (4, '') {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75255) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.lightos [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] LIGHTOS: no hostnqn found. {{(pid=75255) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG os_brick.utils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2c7a26138469', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:59:35 user nova-compute[75255]: DEBUG nova.virt.block_device [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating existing volume attachment record: 78a8d57f-ddf2-4759-81ac-390715b91f8a {{(pid=75255) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 11:59:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Calling os-brick to attach iSCSI Volume {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUdqIsKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 11:59:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:59:39 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 11:59:39 user nova-compute[75255]: INFO os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[21557708-9c62-47a2-b68d-8d614c661ee5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 11:59:39 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3379c234-ad25-4efa-8bfe-e42afcee11ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9] added\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9] added
Nov 14 11:59:39 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab20c66-b9e1-47d1-be69-d2d0240ec9b3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05a9ec-8e37-4008-a9b3-df8c267ab727]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUdqIsKZ {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUdqIsKZ" returned: 0 in 0.023s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c78226-06e5-4b1b-b0ac-f11d7ce0810c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GUdqIsKZ'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:39 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bd6d7c-ef7b-4a80-b9b1-e64977f4e8a7]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bb8b7a-e687-45ba-b5b1-8d7f5c3ec1b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:59:40 user nova-compute[75255]:  {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 11:59:40 user nova-compute[75255]:  {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:59:40 user nova-compute[75255]: WARNING os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 11:59:40 user nova-compute[75255]: 
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --login {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55703a0-944c-4c7f-a745-606434cf829c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260]
Nov 14 11:59:40 user nova-compute[75255]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260] successful.
Nov 14 11:59:40 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7996d91-172f-403a-8801-91429d89b3d9]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[794bab80-ced7-4c55-a396-f0fa06832d18]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 (non-flash)
Nov 14 11:59:40 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 (non-flash)
Nov 14 11:59:40 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to 172.16.0.220:3260 {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75255) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75255) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae1155-8a18-4e33-825a-f70e3512e14b]: (4, ('- - 0', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75255) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUdqIsKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75255) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 11:59:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23033626663356235', 'path': '/dev/sdb'} {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033626663356235', 'path': '/dev/sdb'} {{(pid=75255) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG nova.objects.instance [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 11:59:41 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:59:41 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:59:41 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:59:41 user nova-compute[75255]:   <serial>bf70a403-a77c-44a8-a50f-78d4b26427d9</serial>
Nov 14 11:59:41 user nova-compute[75255]: </disk>
Nov 14 11:59:41 user nova-compute[75255]:  {{(pid=75255) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75255) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] No VIF found with MAC fa:16:3e:6c:8d:b0, not building metadata {{(pid=75255) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 11:59:41 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-618f6d36-c04e-40c5-8ca1-cf13fe2ce238 tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.251s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 11:59:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 11:59:43 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 11:59:43 user nova-compute[75255]: INFO nova.compute.manager [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Detaching volume bf70a403-a77c-44a8-a50f-78d4b26427d9
Nov 14 11:59:43 user nova-compute[75255]: INFO nova.virt.block_device [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Attempting to driver detach volume bf70a403-a77c-44a8-a50f-78d4b26427d9 from mountpoint /dev/vdb
Nov 14 11:59:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Attempting to detach device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config. {{(pid=75255) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 11:59:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:59:43 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:59:43 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:59:43 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:59:43 user nova-compute[75255]:   <serial>bf70a403-a77c-44a8-a50f-78d4b26427d9</serial>
Nov 14 11:59:43 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:59:43 user nova-compute[75255]: </disk>
Nov 14 11:59:43 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:59:43 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the persistent domain config.
Nov 14 11:59:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config. {{(pid=75255) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 11:59:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.guest [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 11:59:43 user nova-compute[75255]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 11:59:43 user nova-compute[75255]:   <source dev="/dev/sdb"/>
Nov 14 11:59:43 user nova-compute[75255]:   <target dev="vdb" bus="virtio"/>
Nov 14 11:59:43 user nova-compute[75255]:   <serial>bf70a403-a77c-44a8-a50f-78d4b26427d9</serial>
Nov 14 11:59:43 user nova-compute[75255]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 11:59:43 user nova-compute[75255]: </disk>
Nov 14 11:59:43 user nova-compute[75255]:  {{(pid=75255) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 11:59:43 user nova-compute[75255]: DEBUG nova.virt.libvirt.driver [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 11:59:45 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:48 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:53 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 11:59:58 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:00:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:03 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:03 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 is timed out.
Nov 14 12:00:03 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully detached device vdb from instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 from the live domain config.
Nov 14 12:00:03 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] calling os-brick to detach iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3285e64a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUdqIsKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:00:04 user nova-compute[75255]: WARNING os_brick.initiator.connectors.base [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9b6af3-f4f4-48bc-a3a6-b587c3958dfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:00:04 user nova-compute[75255]: No targets found.
Nov 14 12:00:04 user nova-compute[75255]: iSNS:
Nov 14 12:00:04 user nova-compute[75255]: No targets found.
Nov 14 12:00:04 user nova-compute[75255]: STATIC:
Nov 14 12:00:04 user nova-compute[75255]: Target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9
Nov 14 12:00:04 user nova-compute[75255]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:00:04 user nova-compute[75255]:                 Iface Name: default
Nov 14 12:00:04 user nova-compute[75255]: FIRMWARE:
Nov 14 12:00:04 user nova-compute[75255]: No targets found.
Nov 14 12:00:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:00:04 user nova-compute[75255]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:00:04 user nova-compute[75255]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75255) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9', 0)] {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b3276-94d5-4c0d-9ccc-b6cbc711ce23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f8bbb1-bbb3-45cb-84ab-850bbe2bf62c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 (non-flash)\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 (non-flash)
Nov 14 12:00:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 (non-flash)
Nov 14 12:00:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30869b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9'): ({'sdb'}, set())}) {{(pid=75255) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Removing single pathed devices sdb {{(pid=75255) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2370607-6d86-42ba-b74e-05533f4816b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[777092ea-b9b0-42f1-b4cd-f85b731ab317]: (4, ('ok\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Flushing IO for device /dev/sdb {{(pid=75255) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8030e2d9-a5a5-4ffd-a317-19c580c2075c]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75255) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9662d7-f10e-4018-a045-ee4972182e49]: (4, ('1', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.linuxscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] SCSI volumes sdb have been removed. {{(pid=75255) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9')] {{(pid=75255) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1e80d-2311-4e72-91c2-9e453b0ea56f]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --logout {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2177d9-e144-411f-8cb7-b373d6b59827]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260]
Nov 14 12:00:04 user nova-compute[75255]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9, portal: 172.16.0.220,3260] successful.
Nov 14 12:00:04 user nova-compute[75255]:  stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op delete {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf70a403-a77c-44a8-a50f-78d4b26427d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ae49b-2cfa-46c8-9eb1-aac329fe55e3]: (4, ('', '')) {{(pid=86497) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75255) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.base [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] <== disconnect_volume: return (308ms) None {{(pid=75255) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:00:04 user nova-compute[75255]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Disconnected iSCSI Volume {{(pid=75255) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:00:05 user nova-compute[75255]: DEBUG nova.objects.instance [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'flavor' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:00:05 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-db9ed756-8def-4254-b9c8-22c76836fa4d tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.571s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:00:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:08 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:00:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:13 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:15 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:17 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:17 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:00:18 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:00:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:18 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.processutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75255) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:00:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:00:20 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:00:20 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.97042465209961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:00:20 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:00:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75255) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:00:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:00:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:00:21 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:00:21 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:00:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:00:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:00:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:23 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:26 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquired lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Forcefully refreshing network info cache for instance {{(pid=75255) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG nova.objects.instance [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lazy-loading 'info_cache' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG nova.network.neutron [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [{"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Releasing lock "refresh_cache-4af3fbd1-da3c-4f3a-aecd-f497a200ea89" {{(pid=75255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:00:27 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updated the network info_cache for instance {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:00:28 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:33 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:00:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:38 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:00:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:00:43 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:46 user nova-compute[75255]: INFO nova.compute.manager [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Terminating instance
Nov 14 12:00:46 user nova-compute[75255]: DEBUG nova.compute.manager [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Start destroying the instance on the hypervisor. {{(pid=75255) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-0b9b9c1e-ed5f-49ee-843c-8683717087cb req-4bff7de6-ec9d-4856-b40a-e61b2831b219 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-vif-unplugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0b9b9c1e-ed5f-49ee-843c-8683717087cb req-4bff7de6-ec9d-4856-b40a-e61b2831b219 service nova] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0b9b9c1e-ed5f-49ee-843c-8683717087cb req-4bff7de6-ec9d-4856-b40a-e61b2831b219 service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-0b9b9c1e-ed5f-49ee-843c-8683717087cb req-4bff7de6-ec9d-4856-b40a-e61b2831b219 service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-0b9b9c1e-ed5f-49ee-843c-8683717087cb req-4bff7de6-ec9d-4856-b40a-e61b2831b219 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] No waiting events found dispatching network-vif-unplugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG nova.compute.manager [req-0b9b9c1e-ed5f-49ee-843c-8683717087cb req-4bff7de6-ec9d-4856-b40a-e61b2831b219 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-vif-unplugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 for instance with task_state deleting. {{(pid=75255) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:00:46 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:47 user nova-compute[75255]: INFO nova.virt.libvirt.driver [-] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Instance destroyed successfully.
Nov 14 12:00:47 user nova-compute[75255]: DEBUG nova.objects.instance [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lazy-loading 'resources' on Instance uuid 4af3fbd1-da3c-4f3a-aecd-f497a200ea89 {{(pid=75255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG nova.virt.libvirt.vif [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T11:54:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-291472576',display_name='tempest-SnapshotDataIntegrityTests-server-291472576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-291472576',id=53,image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXqez8zdG7ufJgHLG+GKDJn8RymthRwETHMp7S2IRH46yis+FKNLWz/QOyOtbGPIqiKGgq65tmydI2VUlPTyyJFX+EYzhlcsG9wdO25m92rtAZ5kTJn2wtQlcaLR0hBbw==',key_name='tempest-keypair-1879102579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T11:54:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19771090150b4496b75a00500243dfeb',ramdisk_id='',reservation_id='r-bxj54rq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26cc9ab5-432f-4182-801c-11cab6c13c7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1019157252',owner_user_name='tempest-SnapshotDataIntegrityTests-1019157252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T11:54:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df537a1822e49f8a6f788765df6314b',uuid=4af3fbd1-da3c-4f3a-aecd-f497a200ea89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Converting VIF {"id": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "address": "fa:16:3e:6c:8d:b0", "network": {"id": "7d77225a-f626-4acf-a055-3afaa8d1aae2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1410249408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19771090150b4496b75a00500243dfeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7247d0-ae", "ovs_interfaceid": "dd7247d0-ae90-4eee-ae60-41779b8457e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG nova.network.os_vif_util [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8d:b0,bridge_name='br-int',has_traffic_filtering=True,id=dd7247d0-ae90-4eee-ae60-41779b8457e1,network=Network(7d77225a-f626-4acf-a055-3afaa8d1aae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7247d0-ae') {{(pid=75255) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG os_vif [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8d:b0,bridge_name='br-int',has_traffic_filtering=True,id=dd7247d0-ae90-4eee-ae60-41779b8457e1,network=Network(7d77225a-f626-4acf-a055-3afaa8d1aae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7247d0-ae') {{(pid=75255) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd7247d0-ae, bridge=br-int, if_exists=True) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e458627-4f1b-4025-819b-987a3cd05077) {{(pid=75255) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:00:47 user nova-compute[75255]: INFO os_vif [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8d:b0,bridge_name='br-int',has_traffic_filtering=True,id=dd7247d0-ae90-4eee-ae60-41779b8457e1,network=Network(7d77225a-f626-4acf-a055-3afaa8d1aae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7247d0-ae')
Nov 14 12:00:47 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Deleting instance files /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89_del
Nov 14 12:00:47 user nova-compute[75255]: INFO nova.virt.libvirt.driver [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Deletion of /opt/stack/data/nova/instances/4af3fbd1-da3c-4f3a-aecd-f497a200ea89_del complete
Nov 14 12:00:47 user nova-compute[75255]: INFO nova.compute.manager [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 12:00:47 user nova-compute[75255]: DEBUG oslo.service.loopingcall [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75255) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG nova.compute.manager [-] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Deallocating network for instance {{(pid=75255) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] deallocate_for_instance() {{(pid=75255) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:00:47 user nova-compute[75255]: DEBUG nova.network.neutron [-] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Updating instance_info_cache with network_info: [] {{(pid=75255) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:00:47 user nova-compute[75255]: INFO nova.compute.manager [-] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Took 0.75 seconds to deallocate network for instance.
Nov 14 12:00:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-c20d42c5-09d2-41b8-975a-8a552f51cd3a req-e2bec95d-25f8-4c29-9268-ca1d5be4552b service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-vif-deleted-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:48 user nova-compute[75255]: INFO nova.scheduler.client.report [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Deleted allocations for instance 4af3fbd1-da3c-4f3a-aecd-f497a200ea89
Nov 14 12:00:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-45e9b406-9c9f-4c8f-9cb4-7e2285dd63fa tempest-SnapshotDataIntegrityTests-1019157252 tempest-SnapshotDataIntegrityTests-1019157252-project-member] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.915s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-9af81487-01bc-4e04-8f55-a9e9ae07eb7e req-ba019638-0dc2-4819-a322-2d17e69624a9 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received event network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9af81487-01bc-4e04-8f55-a9e9ae07eb7e req-ba019638-0dc2-4819-a322-2d17e69624a9 service nova] Acquiring lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9af81487-01bc-4e04-8f55-a9e9ae07eb7e req-ba019638-0dc2-4819-a322-2d17e69624a9 service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [req-9af81487-01bc-4e04-8f55-a9e9ae07eb7e req-ba019638-0dc2-4819-a322-2d17e69624a9 service nova] Lock "4af3fbd1-da3c-4f3a-aecd-f497a200ea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:00:48 user nova-compute[75255]: DEBUG nova.compute.manager [req-9af81487-01bc-4e04-8f55-a9e9ae07eb7e req-ba019638-0dc2-4819-a322-2d17e69624a9 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] No waiting events found dispatching network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 {{(pid=75255) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:00:48 user nova-compute[75255]: WARNING nova.compute.manager [req-9af81487-01bc-4e04-8f55-a9e9ae07eb7e req-ba019638-0dc2-4819-a322-2d17e69624a9 service nova] [instance: 4af3fbd1-da3c-4f3a-aecd-f497a200ea89] Received unexpected event network-vif-plugged-dd7247d0-ae90-4eee-ae60-41779b8457e1 for instance with vm_state deleted and task_state None.
Nov 14 12:00:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:00:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:01:07 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:09 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:10 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:12 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:01:13 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:17 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:17 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:01:19 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:19 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75255) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:01:20 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager.update_available_resource {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Auditing locally available compute resources for user (node: user) {{(pid=75255) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:01:21 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:01:21 user nova-compute[75255]: WARNING nova.virt.libvirt.driver [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:01:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=24.989707946777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75255) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75255) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG nova.compute.provider_tree [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed in ProviderTree for provider: f0f4b442-5a89-43dd-b8f0-d063e03c0c97 {{(pid=75255) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG nova.scheduler.client.report [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Inventory has not changed for provider f0f4b442-5a89-43dd-b8f0-d063e03c0c97 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75255) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG nova.compute.resource_tracker [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Compute_service record updated for user:user {{(pid=75255) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:01:21 user nova-compute[75255]: DEBUG oslo_concurrency.lockutils [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75255) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:01:22 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:01:27 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:27 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:29 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Starting heal instance info cache {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:01:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Rebuilding the list of instances to heal {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:01:29 user nova-compute[75255]: DEBUG nova.compute.manager [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Didn't find any instances for network info cache update. {{(pid=75255) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:01:30 user nova-compute[75255]: DEBUG oslo_service.periodic_task [None req-a1129780-0272-44ce-80b7-a4883a4e45ec None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75255) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:01:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:01:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75255) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:01:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:01:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75255) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:01:32 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:01:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:37 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:40 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:42 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:47 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:52 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:01:57 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:02:02 user nova-compute[75255]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75255) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}